5 Commits

Include renames

Author	SHA1	Message	Date
Daan MeijerandClaude Opus 5.5	2814c77225	A quoted word that isn't a file name; split parts with two digits ... From the re-index's single-file releases: - A quoted text without an extension ("My \"Official\" remaining set's of Inna … 025.jpg [25/74]", "… lr140x16.jpg ( file 046 of 922) \"yEnc\"", "\"Dr. Lust\" - … - [12/21] - Ed_DRL_VDR_LM.part09.rar") was the file name, the real one stayed in the subject: every file a release. It gives way to a file name with an extension beside it (nameBesideQuotes); random quoted names with none beside keep theirs. - Split parts numbered with two digits ("Admiral.EP05.2008.720p.Rus. HDCLUB.mkv.21", a.b.movies.divx.russian) share their stem, as .001. Both implementations; tests; fixtures identical. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-11 23:46:43 +02:00
Daan MeijerandClaude Opus 5.5	90f30f445d	Subjects without a quoted file name: the name from the rest of the subject ... Most "obfuscated" subjects of older and smaller groups name their file without quotes ("DVDFab 8.2.0.5.rar (006/332)", fta's "q3B9…part023.rar (104/137)", "New_Super_Mario_Bros._[Keygen].exe (1/2)") or with one quote ("[keira_s04_0037_l.jpg\" yEnc] (2/2)"): 100% of ath 2013's and fta's, 94% of models' (LOG.md 2026-10-11 (5)). With a segment counter and no quoted name, unquotedName takes the name before a lone quote (after a "[", else after the last space), else the text when it ends in a file name (after "] " or " - "), else its first word that is one; a file counter stuck in a bracket is dropped. The release identity takes such a name out of the subject as it would quotes (else every image of a set was a release: 9,130 instead of 267 on the models fixture). Both implementations; a fourth fixture (fta, 25k lines) and tests; check identical on all four. Truly random subjects (ngPost hex = message-id, random tokens) stay obfuscated. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-11 20:52:55 +02:00
Daan MeijerandClaude Opus 5.5	73fc9aabdf	Rebuild: strings that outlive their chunk are copied (worker 1.14 → 0.66 GB) ... A slice of a chunk's text keeps the whole text alive (tens of MB) for as long as the file it belongs to stays open: message-ids, file details and cache keys are now copies. edge:bench on boneless: peak RSS 1,137 → ~660 MB, external memory 570 → 40–75 MB, the same speed (~190k headers/s); the same results on 800k real lines. edge:bench prints the breakdown. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 02:36:34 +02:00
Daan MeijerandClaude Opus 5.5	db882f0b48	Rebuild: the segment counter by a backwards scan, one cache from poster+subject to the file ... edge:bench (one core): boneless 193k → 215k headers/s, ath 303k → 343k. Same results on 800k real lines. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 01:16:04 +02:00
Daan MeijerandClaude Opus 5.5	638cfa1dcd	Rebuild: a lean overview scan for the edge worker ... The worker reads the XOVER reply's text directly: fields by position, the owner from the Xref without arrays (crossposts leave before any subject parsing), a subject parsed once per file (cached without its segment counter), a file's details as one shared object, dates as numbers. Garbage collection had been ~22% of the time. Same results as parseOverviews + segmentFromHeader on 800k real lines. edge:bench (one core): boneless 137k → 193k headers/s (CPU 21 → 12.8 s), ath (2013) 143k → 303k; peak RSS 1.15 / 0.87 GB. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>	2026-10-09 01:13:41 +02:00