3 Commits

Include renames

Author	SHA1	Message	Date
Daan MeijerandClaude Fable 5.1	1f6e3316ec	The window worker: group leases, the stream serving the corpus, the snapshot through the API (design 1 and 5) ... A worker thread leases a group and takes its ranges in article order through one carried window; the coordinator keeps one cursor a group (group_leases, migration 6500) and hands out the next range, the rules and nothing about where the chunks are: the range stream serves a stored range's chunks from the corpus file and a live one's from the spool. The window's snapshot (bincode: the frontier, the open files, releases and albums, the upload numbers, the batch-counter table) goes to the coordinator every EDGE_SNAPSHOT_MINUTES and when the group is given back, and the next holder restores it; a takeover after LEASE_TTL_SECONDS plans the ranges from the snapshot's article again. The prefetcher runs ahead of held groups' cursors and skips chunks the corpus has. LEASE_MIN_PRIORITY..LEASE_MAX_PRIORITY bound what is leased. edge-node holds groups by default; --ranges keeps the old per-range path. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>	2026-10-26 18:22:18 +01:00
Daan MeijerandClaude Fable 5.1	f8cb17903b	voyager 3: the window in the Rust edge ... The indexer finishes files and releases by posting time instead of the range path: the frontier is the median Date of the last 1,024 plausible dates (within 7 days of it; a run of 1,024 agreeing dates moves it), and a release is finished, judged and written once the frontier is 24 h past its last part, flagged edge when posted within a day of the block's start. At the block's end the rest is written provisionally as edges for the block merger. Files short of parts stay in their release (partial: the store writes complete = false). Gone: fragments and the cut-off, uploads_of (online now), check.ts and the fixture comparison; CI replays the fixtures through edge-bench instead. The wire carries finished, edge and partial. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>	2026-10-25 21:28:35 +01:00
Daan MeijerandClaude Opus 5.5	5109481d67	The Rust worker is the product: edge/, built and checked in CI ... User: Rust is the product (option a). tools/edge-bench-rs moves to edge/ (crate edge; binaries edge-node, the worker, and edge-bench, the replay). CI's new job edge runs cargo test and edge/check-fixtures.sh: both RangeIndexers on three committed captures (edge/fixtures, 25k overview lines each of a.b.models, a.b.ath and a.b.boneless in 5 chunks, 3.5 MB), compared field by field with check.ts; deploy waits for it. The TypeScript RangeIndexer stays as check.ts's reference. README: what it is now; the benchmark findings as history. Random names: looksRandom missed long tokens of capitals and digits ("51294P1CUKR2R35X", release 74539068, readable and a Newznab title). 12+ capitals and digits switching 6+ times between them are random (COD4MW2REMASTERED switches 4 times, BEATLES1964REMASTER twice); both implementations, identical on the fixtures. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-11 20:01:18 +02:00