Daan MeijerandClaude Opus 5.5
be8a3d4580
Spotnet (CONCEPT D29): - Index free.pt fully and import spots with their descriptions, categories and NZBs; a spot renames its release, since Spotnet names are more trustworthy than names derived from subjects. - Find passwords in spot descriptions too, and tell "needs a password we have" from "needs a password we don't have". Content inspection: - List the contents of 7z (.7z.001) archives, SFV sets, nicovideo uploads and other archive-like files; mark yEncBin .bin containers as encrypted. - Take real names from yEnc headers for randomly named files, and merge uploads that were split across posts. Storage (D31, D32): - Store segment lists zstd-compressed behind the FileStore accessor. - group:backfill indexes older headers at low priority and pauses when the NVMe or HDD part of the database gets too large. Grouping (D35, D36): - Lone header segments wait in staged_segments until a second segment of their file arrives, which drops the per-article junk binaries. - Counter grouping joins random-subject uploads by poster, [i/M] counter, part count and day. Search and maintenance (D33, D34): - A trigram-indexed search_text column, smaller indexes, estimated stats. - Passes that clean up nonsense names; weekly index maintenance; GC budgets per kind. - Web UI: grey out stale results while a search runs and cancel superseded requests. Count only up to 1,000 matches for the page, which made filter clicks take seconds (Newznab keeps the 10,000 cap). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
30 lines
989 B
TypeScript
30 lines
989 B
TypeScript
/**
|
|
* SFV checksum lists: one `name CRC32` per line, `;` comments. Scene
|
|
* releases (music in particular) post one with every album; it names every
|
|
* file that belongs to it.
|
|
*/
|
|
export interface SfvEntry {
|
|
name: string
|
|
crc: string
|
|
}
|
|
|
|
export function parseSfv(text: string): SfvEntry[] {
|
|
const entries: SfvEntry[] = []
|
|
for (const raw of text.split(/\r?\n/)) {
|
|
const line = raw.trim()
|
|
if (!line || line.startsWith(';')) continue
|
|
const match = /^(.+?)\s+([0-9a-f]{8})$/i.exec(line)
|
|
if (match) entries.push({ name: match[1].replace(/^"|"$/g, '').split(/[\\/]/).pop()!, crc: match[2].toLowerCase() })
|
|
}
|
|
return entries
|
|
}
|
|
|
|
/**
|
|
* The album name an SFV gives a release: its stem without the leading
|
|
* track number scene groups put on the playlist/SFV/cover files
|
|
* (`00-artist-album-web-2026-grp.sfv` → `artist-album-web-2026-grp`).
|
|
*/
|
|
export function sfvReleaseName(sfvName: string): string {
|
|
return sfvName.replace(/\.sfv$/i, '').replace(/^0{1,3}-/, '')
|
|
}
|