Daan MeijerandClaude Opus 5.5 9dc0a27bb4 Rebuild: a lease never waits for prefetching; one-shot hashes ...

A lease was only granted for a range with spooled chunks, and the
prefetcher kept ranges ahead per active lease: once the spool ran dry a
worker got none and slept 30 s, fewer ranges were leased, fewer
prefetched. Three workers held one lease between them (~50k headers/s).
A lease now takes a spooled range first, else the next planned one
(leased ranges are fetched first; the stream waits).

crypto.hash instead of createHash().update().digest() for file and
release keys: same digests, ~2.5x faster (~4.6% of a worker's time).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-09 03:08:19 +02:00

..

file_key.ts

Rebuild: a lease never waits for prefetching; one-shot hashes

2026-10-09 03:08:19 +02:00

index.ts

Rebuild: a file's identity is computed once per batch, not per article

2026-10-09 01:08:58 +02:00

segment.ts

Rebuild: a file's identity is computed once per batch, not per article

2026-10-09 01:08:58 +02:00

subject.ts

Rebuild: phase 1 modules from the current app, ordered by pipeline stage

2026-10-09 00:08:44 +02:00