Passage-level retrieval module + offline LegalBench ablation harness

↗ view on GitHub · Eli Ziff · 2026-07-30 · 3997cf12

Replaces the four measured defects of the doc-level search path:
boundary-aware offset-preserving chunker (RCTS family), OR-semantics
weighted-bm25 over a derived sidecar FTS5 passage index (source db
never written), doc name/citation columns on every passage row so
document-naming queries boost their passages, per-doc diversity cap,
and rrfFuse as the standing hybrid fusion point for a dense lane.
Every hit returns exact char offsets with a verbatim-slice invariant
(unit-tested, 7 vectors). Ablation harness sweeps chunk/weight
configs against the 776-test human gold deterministically at zero
model cost.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 799948f9
Stats 3 files changed , +593
Part of Evaluation harness: Beaver-CAN and LegalBench-RAG adapters

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-3997cf12.md from inside the repo you want the change in.

⬇ Download capture-commit-3997cf12.md