Daan MeijerandClaude Fable 5.1 1f6e3316ec The window worker: group leases, the stream serving the corpus, the snapshot through the API (design 1 and 5) ...

A worker thread leases a group and takes its ranges in article order through
one carried window; the coordinator keeps one cursor a group (group_leases,
migration 6500) and hands out the next range, the rules and nothing about
where the chunks are: the range stream serves a stored range's chunks from the
corpus file and a live one's from the spool. The window's snapshot (bincode:
the frontier, the open files, releases and albums, the upload numbers, the
batch-counter table) goes to the coordinator every EDGE_SNAPSHOT_MINUTES and
when the group is given back, and the next holder restores it; a takeover
after LEASE_TTL_SECONDS plans the ranges from the snapshot's article again.
The prefetcher runs ahead of held groups' cursors and skips chunks the corpus
has. LEASE_MIN_PRIORITY..LEASE_MAX_PRIORITY bound what is leased. edge-node
holds groups by default; --ranges keeps the old per-range path.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-10-26 18:22:18 +01:00

..

fixtures/sevenzip

Probe 7z listings and ZIP starts

2026-10-23 11:55:07 +02:00

functional

The window worker: group leases, the stream serving the corpus, the snapshot through the API (design 1 and 5)

2026-10-26 18:22:18 +01:00

unit

The pending ladder in the prober: unnamed releases probed cheapest first, signatures learned, the named moved into the catalog

2026-10-26 13:41:30 +01:00

bootstrap.ts

voyager 3: the batch store writes releases once, by id references and bytea keys

2026-10-25 21:04:03 +01:00