Daan MeijerandClaude Opus 5.5 18f5d27413 Prober: claim from random points of the queue, not in id order ...

In id order the prober went group by group, and some groups' articles
take 0.6-3 s each (a.b.zogg 2016; repeated fetches the same, pipelining
4 deep no faster), where a sample across all years takes 20-60 ms for
most: 7 articles/s on 6 connections, against 67/s in its first minutes.
A claim now takes 20 slices from random points (353 ms per 200).
tools/body_timing.ts: BODY time for the oldest and newest candidates.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-11 15:55:23 +02:00

.adonisjs

Rebuild: tools to rank groups by real span (GROUP's low) and sample how full they are

2026-10-09 13:31:55 +02:00

.gitea/workflows

Rebuild: a proper deployment for voyager 2

2026-10-10 00:01:38 +02:00

app

Prober: claim from random points of the queue, not in id order

2026-10-11 15:55:23 +02:00

bin

Rebuild: coordinator (planner, NNTP pool, spool, prefetcher, leases, rule sets), node API and the edge:node worker

2026-10-09 00:31:06 +02:00

commands

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

config

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

database

Prober: an inspection per candidate; no inner name that is the release's name

2026-10-11 15:37:32 +02:00

deploy

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

lib

Prober: no packaging or release-name-plus-extension as inner name

2026-10-11 15:44:08 +02:00

providers

omgebouwd naar adonisjs, werkt nog niet echt goed

2026-06-03 23:41:09 +02:00

public

Rebuild: completeness as indexed, file totals from any counter, pausable tails, progress by articles

2026-10-09 13:06:03 +02:00

start

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

tests

Prober: no packaging or release-name-plus-extension as inner name

2026-10-11 15:44:08 +02:00

tools

Prober: claim from random points of the queue, not in id order

2026-10-11 15:55:23 +02:00

types

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

.dockerignore

Rebuild: a proper deployment for voyager 2

2026-10-10 00:01:38 +02:00

.editorconfig

omgebouwd naar adonisjs, werkt nog niet echt goed

2026-06-03 23:41:09 +02:00

.env.example

Rebuild: fresh AdonisJS 7 API app on Postgres

2026-10-09 00:05:24 +02:00

.env.test

Rebuild: first end-to-end runs; prefetch per chunk, executable rule, wire fixes

2026-10-09 01:07:11 +02:00

.gitignore

Rebuild: the catalog API and Newznab, from voyager 1

2026-10-09 10:45:47 +02:00

.nvmrc

implemented a lot of features

2026-09-29 00:32:01 +02:00

.prettierignore

omgebouwd naar adonisjs, werkt nog niet echt goed

2026-06-03 23:41:09 +02:00

ace.js

omgebouwd naar adonisjs, werkt nog niet echt goed

2026-06-03 23:41:09 +02:00

adonisrc.ts

Rebuild: the catalog API and Newznab, from voyager 1

2026-10-09 10:45:47 +02:00

Dockerfile

Rebuild: a proper deployment for voyager 2

2026-10-10 00:01:38 +02:00

eslint.config.js

omgebouwd naar adonisjs, werkt nog niet echt goed

2026-06-03 23:41:09 +02:00

package-lock.json

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

package.json

Rebuild: phase 2's prober reads the probe queue

2026-10-11 15:32:49 +02:00

REBUILD.md

REBUILD.md: the deployment

2026-10-10 00:10:44 +02:00

tsconfig.json

Rebuild: fresh AdonisJS 7 API app on Postgres

2026-10-09 00:05:24 +02:00

S

Description

No description provided

8.1 MiB

0 Stars 1 Watchers 0 Forks

Languages

TypeScript 95.5%

JavaScript 2.4%

CSS 1.4%

HTML 0.6%

Dockerfile 0.1%