4 Commits

Include renames

Author	SHA1	Message	Date
Daan MeijerandClaude Opus 5.5	90f30f445d	Subjects without a quoted file name: the name from the rest of the subject ... Most "obfuscated" subjects of older and smaller groups name their file without quotes ("DVDFab 8.2.0.5.rar (006/332)", fta's "q3B9…part023.rar (104/137)", "New_Super_Mario_Bros._[Keygen].exe (1/2)") or with one quote ("[keira_s04_0037_l.jpg\" yEnc] (2/2)"): 100% of ath 2013's and fta's, 94% of models' (LOG.md 2026-10-11 (5)). With a segment counter and no quoted name, unquotedName takes the name before a lone quote (after a "[", else after the last space), else the text when it ends in a file name (after "] " or " - "), else its first word that is one; a file counter stuck in a bracket is dropped. The release identity takes such a name out of the subject as it would quotes (else every image of a set was a release: 9,130 instead of 267 on the models fixture). Both implementations; a fourth fixture (fta, 25k lines) and tests; check identical on all four. Truly random subjects (ngPost hex = message-id, random tokens) stay obfuscated. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-11 20:52:55 +02:00
Daan MeijerandClaude Opus 5.5	9dc0a27bb4	Rebuild: a lease never waits for prefetching; one-shot hashes ... A lease was only granted for a range with spooled chunks, and the prefetcher kept ranges ahead per active lease: once the spool ran dry a worker got none and slept 30 s, fewer ranges were leased, fewer prefetched. Three workers held one lease between them (~50k headers/s). A lease now takes a spooled range first, else the next planned one (leased ranges are fetched first; the stream waits). crypto.hash instead of createHash().update().digest() for file and release keys: same digests, ~2.5x faster (~4.6% of a worker's time). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 03:08:19 +02:00
Daan MeijerandClaude Opus 5.5	981bc01810	Rebuild: a file's identity is computed once per batch, not per article ... The file key and release identity (two SHA-1 hashes and the release rules) were ~25% of the edge worker's time. edge:bench: boneless 100k → 137k headers/s on one core, ath (2013) 70k → 143k. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 01:08:58 +02:00
Daan MeijerandClaude Opus 5.5	d773c91ad0	Rebuild: phase 1 modules from the current app, ordered by pipeline stage ... lib/nntp (XOVER client, Xref, GROUP), lib/headers (subjects, file keys, segments from overview lines; the yEnc path stays behind for phase 2), lib/release (identity, random names, now in lib), lib/files (aggregator, volume names), lib/rules (posting tools, owner by priority, release verdicts), lib/chunks (release chunk codec). Their unit tests came along; new ones for codec, rules and volumes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 00:08:44 +02:00