daan
0 Followers · 0 Following
Joined on 2025-02-09
Repositories
3
 Projects Packages Public Activity Starred Repositories
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:19:54 +02:00
b862201991 Rebuild: the fragment merger
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:17:23 +02:00
2c14315f94 Rebuild: fragments only for files an edge cut; lone random articles are per-article
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 02:09:06 +02:00
5ba93f558c Rebuild: XOVER chunks of 100k lines; batches by articles
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 01:36:30 +02:00
08c876b690 Rebuild: XOVER replies are joined once, when complete
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 01:32:38 +02:00
ead2790515 Rebuild: edge:node --processes (one worker per core, supervised)
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 01:31:21 +02:00
fa7d4f3394 Rebuild: end-to-end fixes — spool accounting, keep-alive frames, resume point, overlapped worker
db882f0b48 Rebuild: the segment counter by a backwards scan, one cache from poster+subject to the file
Compare 2 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 01:13:42 +02:00
638cfa1dcd Rebuild: a lean overview scan for the edge worker
981bc01810 Rebuild: a file's identity is computed once per batch, not per article
Compare 2 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 01:07:13 +02:00
cd06f96f85 Rebuild: first end-to-end runs; prefetch per chunk, executable rule, wire fixes
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 00:31:08 +02:00
d5f168d8d2 Rebuild: coordinator (planner, NNTP pool, spool, prefetcher, leases, rule sets), node API and the edge:node worker
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 00:21:18 +02:00
20910647fa Rebuild: the batch store (catalog upserts, write-once chunks, candidates, rule counts, fragments, resume point)
0714b2c81a Rebuild: a dedicated Postgres for development (its own database, as in production)
2209921846 Rebuild: schema for groups, rule sets, ranges, release catalog, chunk store, fragments, probe queue, rule bookkeeping and nodes
Compare 3 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 00:17:27 +02:00
a18ead666b Rebuild: edge:bench, and its result in the spec (TypeScript is fast enough)
7dc316c987 Rebuild: the edge worker's range indexer
Compare 2 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 00:08:46 +02:00
d773c91ad0 Rebuild: phase 1 modules from the current app, ordered by pipeline stage
96f0ade10e Rebuild: fresh AdonisJS 7 API app on Postgres
699395c51f Rebuild spec: a worker streams its whole range in one request
Compare 3 commits »
daan pushed to rebuild at daan/usenet-indexer 2026-10-08 23:57:20 +02:00
06f5d81fbb Rebuild spec: d and e decided; coordinator prefetches ranges into a spool
daan pushed to rebuild at daan/usenet-indexer 2026-10-08 23:54:23 +02:00
76ecef81af Rebuild spec: a, b, c decided; group list with priority-based crosspost owners
daan pushed to rebuild at daan/usenet-indexer 2026-10-08 23:39:37 +02:00
1931c7f66c Rebuild spec: rules and recovery (counts per range and rule, rule versions, a sample)
daan pushed to rebuild at daan/usenet-indexer 2026-10-08 23:31:19 +02:00
2d4f3f48cf Rebuild spec: workers return probe candidates per release; a probe queue
daan pushed to master at daan/usenet-indexer 2026-10-08 23:08:35 +02:00
7c43abd230 files:move-details: short batches, so files deleted meanwhile don't fail the copy
daan pushed to rebuild at daan/usenet-indexer 2026-10-08 19:37:30 +02:00
16e504a8fb Rebuild: spec draft (header-first indexer)
daan created branch rebuild in daan/usenet-indexer 2026-10-08 19:37:29 +02:00
daan pushed to master at daan/usenet-indexer 2026-10-08 19:36:43 +02:00
fad1716d3a Content type and archive listing move from files to file_details