feat: LegalBench-RAG-mini retrieval adapter (eval plan Issue 5)
Pinned reproducible setup (mini.manifest.json: upstream MIT repo/URL, deterministic 194-tests-per-source derivation, sha256 of all 73 derived files; corpus stays git-ignored), char-span precision/recall@k metrics per the upstream formulas, and an end-to-end run of the product's existing retrieval plane (FTS5 bm25 searchLocalA2AJ + snippet window via the existing import_a2aj_bulk.py) emitting a validated Issue-1 run trace with retrieved-token volume. No model calls, no new dependencies. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016yXxuitxX5h4wm1v88hnga
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | 0db47d69 |
| Stats | 6 files changed , +1529 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-58fcdf83.md
from inside the repo you want the change in.