daan pushed to rebuild at daan/usenet-indexer 2026-10-10 13:12:29 +02:00
fc1c64d5c0 Rebuild: drop NUL from batches; chunk deadline 180 s
daan pushed to rebuild at daan/usenet-indexer 2026-10-10 08:44:11 +02:00
f4c0417066 Rebuild: enough ranges being fetched for every connection
daan pushed to rebuild at daan/usenet-indexer 2026-10-10 08:30:08 +02:00
40aa78cda3 Rebuild: a deadline per chunk; batches with a huge fragment
daan pushed to rebuild at daan/usenet-indexer 2026-10-10 00:10:45 +02:00
e095232d89 REBUILD.md: the deployment
daan pushed to rebuild at daan/usenet-indexer 2026-10-10 00:06:09 +02:00
84d3af5511 Rebuild: a proper deployment for voyager 2
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 23:33:44 +02:00
678b3dd438 Rebuild: spread prefetch connections over ranges and groups
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 22:40:51 +02:00
4bf526ab6e Rebuild: prefetch report samples what the connections do
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 22:13:45 +02:00
8475969145 Rebuild: hedged chunk fetches and connection max age (both off by default)
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 21:36:44 +02:00
fc8ec9ff48 Rebuild: tools/compress_ab.ts, compressed vs plain XOVER side by side
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 21:05:38 +02:00
8442c4fc44 Rebuild: 2-minute NNTP reply timeout; the Rust worker runs on homelab
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 20:42:10 +02:00
a8a139c6d9 edge-node: the edge worker in Rust
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 20:27:20 +02:00
dce9967806 edge-bench-rs: a library for the worker; rules from the lease; the wire format
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 18:05:03 +02:00
fc86dd00d1 Rebuild: a batch locks its range with an advisory lock, not the row
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 17:49:46 +02:00
99fffe30f4 Rebuild: stats from a fixed-size sample, refreshed every 5 minutes, given up after 2
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 17:45:07 +02:00
f642a49d7d Rebuild: post a batch early when 100k files wait; log failing stats refreshes
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 14:10:50 +02:00
508d8b5723 Rebuild: one advisory lock per group when writing releases, not per key
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 13:55:21 +02:00
7836436605 edge-bench-rs README: the a.b.models capture (image sets, re-uploads); where the captures are
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 13:51:26 +02:00
cfe85abc3e Rebuild: chunks the server's compression cuts short are fetched plain
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 13:31:56 +02:00
3737ea1542 Rebuild: tools to rank groups by real span (GROUP's low) and sample how full they are
daan pushed to rebuild at daan/usenet-indexer 2026-10-09 13:31:36 +02:00
0613984de9 Rebuild: re-uploads are releases of their own