Daan MeijerandClaude Opus 5.5 2178847513 Stop refilling parts of binaries that are already a file ...

Crossposts, reposts and backfill ranges keep bringing articles of files
that worker:file already created. Ingest inserted their header parts again,
and GC's copied-parts pass (which searched all binaries for parts on every
batch) removed only 150k-450k per sweep: parts grew to 68M rows, 56M of
them belonging to finished files, and the 23 GB table paused the backfill.

- Ingest skips header parts (no per-part CRC) for binaries with a file_id.
- GC drops copied parts with a cursor over binaries, 2000 per statement.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-04 02:53:11 +02:00

..

backfill.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

counter_grouping.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

deferred.spec.ts

implemented a lot of features

2026-09-29 00:32:01 +02:00

fetch_ranges.spec.ts

implemented a lot of features

2026-09-29 00:32:01 +02:00

ingest.spec.ts

Stop refilling parts of binaries that are already a file

2026-10-04 02:53:11 +02:00

names.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

newznab.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

nzb_import.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

par2_attach.spec.ts

implemented a lot of features

2026-09-29 00:32:01 +02:00

random_names.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

release_merge.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

search_text.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

sfv.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

split.spec.ts

implemented a lot of features

2026-09-29 00:32:01 +02:00

spot_listing.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

staging.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

web_api.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00

yenc_name.spec.ts

Spotnet import, header backfill, staging and counter grouping, faster search

2026-10-03 19:59:23 +02:00