Backfill scripts: paginate past PostgREST's 1000-row cap

↗ view on GitHub · emileriksenkeev · 2026-07-17 · 0b44a4f6

The workspace outgrew 1000 documents, so the full-corpus embeddings
backfill silently fetched only the oldest 1000 and dropped the newest
~200 (the People-HR batch among them) while reporting success. The
document_chunks select hit the same cap, so the already-embedded set
was also incomplete. Page both queries with .range() in both scripts.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Repository emileriksenkeev/sydOS
Author emileriksenkeev <emil@keev.co>
Authored
Parents 71413433
Stats 2 files changed , +76 , -24
Part of Semantic search over project documents (pgvector + Voyage)

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-0b44a4f6.md from inside the repo you want the change in.

⬇ Download capture-commit-0b44a4f6.md