From 104248d8a3893aa41adfb65c64a662a7911a5a4d Mon Sep 17 00:00:00 2001 From: Daan Meijer Date: Fri, 9 Oct 2026 07:48:14 +0200 Subject: [PATCH] Rebuild spec: homelab measurements Co-Authored-By: Claude Opus 5.5 --- REBUILD.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/REBUILD.md b/REBUILD.md index 51aad43..ee8b595 100644 --- a/REBUILD.md +++ b/REBUILD.md @@ -29,6 +29,15 @@ search. Measured on the workstation (4 cores, 100 Mbit, Eweka): each; server side ~17% (coordinator) + ~8% (web) + ~3% (Postgres) of a core. (Before this round's fixes Postgres was at 32%: the merger's neighbour query read every range per file.) +- On homelab (12 cores, 1 Gbit; 2026-10-09, separate containers and + database, `/mnt/bulk/usenet-rebuild`): 20 connections fetched ~630 k + articles/s (~31 k per connection, ~3 s per 100 k chunk, ~250 Mbit/s at + ~50 B per article on older boneless) and 8 worker processes indexed all of + it, waiting for the spool (~366 M headers in ~12 minutes). Server side at + that rate: coordinator 0.4–0.5 cores (1.3–1.7 before it stopped + inflating replies to check them), web 0.3–0.45, Postgres (on the HDD) + under 0.15. Worker per core there: ~195 k headers/s (boneless 2026), + ~275 k (ath 2013). - Storage: chunks 17.9–20.3 B per segment (format v2); a release ~1.1 KB. - For the whole target (528 B overview lines): ~36 TB of compressed XOVER to download. At 50 connections (~1–1.25 M lines/s, ~0.6–0.7 Gbit/s)