Daan MeijerandClaude Opus 5.5
be8a3d4580
Spotnet (CONCEPT D29): - Index free.pt fully and import spots with their descriptions, categories and NZBs; a spot renames its release, since Spotnet names are more trustworthy than names derived from subjects. - Find passwords in spot descriptions too, and tell "needs a password we have" from "needs a password we don't have". Content inspection: - List the contents of 7z (.7z.001) archives, SFV sets, nicovideo uploads and other archive-like files; mark yEncBin .bin containers as encrypted. - Take real names from yEnc headers for randomly named files, and merge uploads that were split across posts. Storage (D31, D32): - Store segment lists zstd-compressed behind the FileStore accessor. - group:backfill indexes older headers at low priority and pauses when the NVMe or HDD part of the database gets too large. Grouping (D35, D36): - Lone header segments wait in staged_segments until a second segment of their file arrives, which drops the per-article junk binaries. - Counter grouping joins random-subject uploads by poster, [i/M] counter, part count and day. Search and maintenance (D33, D34): - A trigram-indexed search_text column, smaller indexes, estimated stats. - Passes that clean up nonsense names; weekly index maintenance; GC budgets per kind. - Web UI: grey out stale results while a search runs and cancel superseded requests. Count only up to 1,000 matches for the page, which made filter clicks take seconds (Newznab keeps the 10,000 cap). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
40 lines
1.3 KiB
TypeScript
40 lines
1.3 KiB
TypeScript
import { NNTP } from 'nntp-js'
|
|
import { delimitedReader } from './delimited_reader.js'
|
|
|
|
const CRLF = new Uint8Array([13, 10])
|
|
|
|
/**
|
|
* nntp-js with its reply reader replaced by `delimitedReader` (see there for
|
|
* the bugs it fixes; the empty-reply one hung XOVER of empty ranges forever).
|
|
* The reader is created in `connect`, so that is overridden: the same steps
|
|
* as nntp-js 1.0.4, with the other reader.
|
|
*/
|
|
const proto = NNTP.prototype as any
|
|
if (!proto.__delimitedReader) {
|
|
proto.__delimitedReader = true
|
|
proto.connect = async function (this: any, readermode = false, timeout: number | undefined = undefined, socket?: any) {
|
|
try {
|
|
this.sock = socket ?? this._createSocket(timeout)
|
|
// The first reply is always the one-line welcome.
|
|
this.byteReader = delimitedReader(this.sock, CRLF)
|
|
this.welcome = new TextDecoder('utf-8').decode(await this._getresp())
|
|
this.caps = undefined
|
|
this.connected = true
|
|
await this.getcapabilities()
|
|
this.readermodeAfterauth = false
|
|
if (readermode && !this.caps.READER) {
|
|
await this._setreadermode()
|
|
if (!this.readermodeAfterauth) {
|
|
this.caps = undefined
|
|
await this.getcapabilities()
|
|
}
|
|
}
|
|
} catch (error) {
|
|
this.sock?.end()
|
|
throw error
|
|
}
|
|
}
|
|
}
|
|
|
|
export { NNTP }
|