Benjamin Admin 7c5592b50e feat(pipeline): add checkpoint to dedup Phase 2 — survives container restart
Stores last_control_id in canonical_generation_jobs after each page.
On restart, resumes from checkpoint instead of starting over.
Checkpoint is deleted on completion.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-29 09:12:23 +02:00
S
Description
No description provided
53 MiB
Languages
Python 38.7%
TypeScript 33.8%
Go 22.8%
HTML 2.9%
Shell 0.8%
Other 1%