4 Commits

Include renames

Author	SHA1	Message	Date
Daan MeijerandClaude Fable 5.1	e470e231d0	Single-archive rules: stub archives and nonsense pieces dropped at the edge ... The judge gets each file's articles seen and bytes, and whether the window closed on the release. A settled release of one unsplit archive posted to 2+ groups is dropped as a stub archive when its articles are <= 256 KiB with the release >= 1 MB, or it is in 4+ groups, or by a webmail poster (those two under 100 MB); releases touching music, e-book, comics, tabs or fonts groups are exempt. A one-article archive of 100 kB-1 MB under a release-like, unscrambled name without spaces or an e-book format is dropped as a nonsense piece. Both switched by the rule set (dropStubArchives, dropNonsensePieces), mirrored in lib/rules, sampled like every drop (LOG.md (123)-(127)). Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>	2026-10-31 11:35:46 +01:00
Daan MeijerandClaude Opus 5.5	cfce8884d4	Lone articles under scrambled names are per-article; inactive groups get no corpus fill ... One article of a multi-part file under a name like "nYDeXeF49dieZ1J7flK-JFzZ3j.ZEDsr" or "bslXlwgPiqZadhRa" (a random subject and poster per article, with fake counters) was a release: looksRandom misses these names for their separators. 160k of alt.binaries.storage's 162k non-Bob releases, and about 60% of all single-article releases in a 2% sample. looks_scrambled / isScrambledFile: at least half the stem's letters and digits in tokens of 5+ that switch case or letter/digit 3 times or more (93% of the storage spam). Used for lone articles given up before the block's end only; at the end the strict looksRandom stays, as the rest of such a file can be in the next block. The namer's re-index (partialFiles) does the same. The prefetcher's corpus fill skips groups that aren't active. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-29 22:19:11 +01:00
Daan MeijerandClaude Opus 5.5	3d24db5565	Rules drop posters at the header pass: the CelebMovie family (rule set version 3) ... Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-16 11:36:46 +02:00
Daan MeijerandClaude Opus 5.5	d773c91ad0	Rebuild: phase 1 modules from the current app, ordered by pipeline stage ... lib/nntp (XOVER client, Xref, GROUP), lib/headers (subjects, file keys, segments from overview lines; the yEnc path stays behind for phase 2), lib/release (identity, random names, now in lib), lib/files (aggregator, volume names), lib/rules (posting tools, owner by priority, release verdicts), lib/chunks (release chunk codec). Their unit tests came along; new ones for codec, rules and volumes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 00:08:44 +02:00