Daan Meijer and Claude Opus 5.5
df89045f98
Rebuild spec: decision f, no chunks for random-named releases in the header pass
...
Test and deploy / test (push) Successful in 38s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 10:17:33 +02:00
Daan Meijer and Claude Opus 5.5
356d8db6b6
Rebuild spec: point to the edge-bench-rs README
...
Test and deploy / test (push) Successful in 28s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 09:40:50 +02:00
Daan Meijer and Claude Opus 5.5
b1a6f02de6
Rebuild spec: TypeScript vs Rust for the edge worker, measured
...
Test and deploy / test (push) Successful in 42s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 09:38:03 +02:00
Daan Meijer and Claude Opus 5.5
42b6cac3ee
Rebuild: edge:node --max-mbit caps a node's download
...
Test and deploy / test (push) Successful in 38s
Test and deploy / deploy (push) Skipped
For workers on a shared line (poweredge-kantoor: 160 Mbit/s): the range
stream is read at most at the cap, TCP holds the coordinator back. The
cap is the node's, split over its processes (also EDGE_MAX_MBIT).
REBUILD.md: where workers run (connections set the speed; remote workers
take CPU off homelab).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 09:01:57 +02:00
Daan Meijer and Claude Opus 5.5
104248d8a3
Rebuild spec: homelab measurements
...
Test and deploy / test (push) Successful in 22s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 07:48:14 +02:00
Daan Meijer and Claude Opus 5.5
53bfea8d15
Rebuild spec: measurements after the second performance round
...
Test and deploy / test (push) Successful in 23s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 03:37:04 +02:00
Daan Meijer and Claude Opus 5.5
69f1cc63b2
Rebuild: coordinator:run --shard=i/n splits prefetching over processes
...
The coordinator's event loop was 16.5% busy at ~10 MB/s of compressed
XOVER (socket reads, buffers, GC, spool writes; nothing stands out), so
one process tops out around 60 MB/s: less than 50 connections bring
(~1M articles/s, ~70-86 MB/s). A shard prefetches the ranges with
id % n = i - 1 with its own NNTP_CONNECTIONS; only shard 1 plans, merges
and settles. Two shards of 5 connections fetched what one of 10 did.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 03:36:24 +02:00
Daan Meijer and Claude Opus 5.5
583ea1ded6
Rebuild spec: status and measurements so far
...
Test and deploy / test (push) Successful in 19s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 02:53:36 +02:00
Daan Meijer and Claude Opus 5.5
20910647fa
Rebuild: the batch store (catalog upserts, write-once chunks, candidates, rule counts, fragments, resume point)
...
Test and deploy / test (push) Successful in 20s
Test and deploy / deploy (push) Skipped
A batch is stored in one transaction and only at its range's resume
point, so a retried batch can't count twice. Garbage is judged before
per-article: a dropped tool isn't worth reading bodies for either.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 00:21:17 +02:00
Daan Meijer and Claude Opus 5.5
a18ead666b
Rebuild: edge:bench, and its result in the spec (TypeScript is fast enough)
...
Test and deploy / test (push) Successful in 19s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 00:17:26 +02:00
Daan Meijer and Claude Opus 5.5
699395c51f
Rebuild spec: a worker streams its whole range in one request
...
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-09 00:01:03 +02:00
Daan Meijer and Claude Opus 5.5
06f5d81fbb
Rebuild spec: d and e decided; coordinator prefetches ranges into a spool
...
Test and deploy / test (push) Successful in 1m11s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 23:57:17 +02:00
Daan Meijer and Claude Opus 5.5
76ecef81af
Rebuild spec: a, b, c decided; group list with priority-based crosspost owners
...
Test and deploy / test (push) Successful in 1m9s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 23:54:20 +02:00
Daan Meijer and Claude Opus 5.5
1931c7f66c
Rebuild spec: rules and recovery (counts per range and rule, rule versions, a sample)
...
Test and deploy / test (push) Successful in 1m3s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 23:39:36 +02:00
Daan Meijer and Claude Opus 5.5
2d4f3f48cf
Rebuild spec: workers return probe candidates per release; a probe queue
...
Test and deploy / test (push) Successful in 1m4s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 23:31:18 +02:00
Daan Meijer and Claude Opus 5.5
16e504a8fb
Rebuild: spec draft (header-first indexer)
...
Test and deploy / test (push) Successful in 1m21s
Test and deploy / deploy (push) Skipped
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 19:37:26 +02:00