daan pushed to rebuild at daan/usenet-indexer 2026-10-09 13:06:05 +02:00
d0f3497ec9 Rebuild: completeness as indexed, file totals from any counter, pausable tails, progress by articles
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 12:23:48 +02:00
7b7175c229 Rebuild: an image without words around it is keyed as a stem
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 12:21:01 +02:00
14758a5b7a Rebuild: image sets, documents and audio albums as releases
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 11:23:35 +02:00
59481037fb Rebuild: a poster's constant tag no longer makes one release of all their uploads
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 10:50:56 +02:00
3d256619e5 Rebuild spec: status (live tail, API, web interface, signatures)
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 10:48:01 +02:00
b97edf02c5 Rebuild: the web interface, from voyager 1
8e52bff213 Rebuild: the catalog API and Newznab, from voyager 1
57dfa3d749 Rebuild: rules:signatures, and voyager 1's 29 learned garbage signatures
fd0f2bde75 Rebuild: the live tail
Compare 4 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 10:17:36 +02:00
df89045f98 Rebuild spec: decision f, no chunks for random-named releases in the header pass
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 09:57:20 +02:00
c5e0ad1f9f Rebuild: tools/xover_eras.ts, XOVER speed per era of a group
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 09:40:53 +02:00
356d8db6b6 Rebuild spec: point to the edge-bench-rs README
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 09:40:46 +02:00
122a054eab edge-bench-rs: README with the findings and how to compare the outputs
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 09:38:07 +02:00
b1a6f02de6 Rebuild spec: TypeScript vs Rust for the edge worker, measured
c7b4ebe470 edge-bench-rs: libdeflate for chunks, memchr for lines and tabs
b1c2db5984 edge-bench-rs: upload tools, release-name checks and common Date headers by hand
43e74199d4 edge-bench-rs: file stems and subject remainders by hand, mimalloc
bacc9aa3b3 Rebuild: edge-bench-rs, the edge worker's indexing in Rust, for comparison
Compare 5 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 09:02:02 +02:00
42b6cac3ee Rebuild: edge:node --max-mbit caps a node's download
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 07:48:16 +02:00
104248d8a3 Rebuild spec: homelab measurements
babd3d781d Rebuild: test the corrupt-chunk report
a979b5d11c Rebuild: the coordinator spools replies without inflating them
Compare 3 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 03:37:18 +02:00
53bfea8d15 Rebuild spec: measurements after the second performance round
69f1cc63b2 Rebuild: coordinator:run --shard=i/n splits prefetching over processes
462da5c225 Rebuild: a stopping worker notices it on keep-alive frames too
883d85e91d Rebuild: the coordinator stops on SIGTERM
cae6e4f60d Rebuild: prefetch stats a minute; the completeness check inflates off the event loop
Compare 9 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:53:37 +02:00
583ea1ded6 Rebuild spec: status and measurements so far
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:49:46 +02:00
821de668d0 Rebuild: the merger stops when a pass over the file keys decides nothing
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:36:36 +02:00
73fc9aabdf Rebuild: strings that outlive their chunk are copied (worker 1.14 → 0.66 GB)
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:33:48 +02:00
80c920f678 Rebuild: settling quiet releases
fde1e6cc90 Rebuild: NZBs from the chunk store, and a catalog search
Compare 2 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:32:00 +02:00
e9592dfd33 Rebuild: chunk format v2 — nyuu and hex message-ids as bits
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:25:47 +02:00
31493a98be Rebuild: merger rounds with one neighbour query, a cursor and a time budget; planning skips failing groups