grounding: source-anchored re-test PASSES on RegLab expert labels

↗ view on GitHub · Eli Ziff · 2026-07-30 · 91b58342

CourtListener citation-lookup went 401 (auth now required), so
resolution/fetch moved to CAP static files (anonymous CDN): 289/442
citations resolved, 294 casebodies. Scoring each claim against its own
cited cases with the shipped lintLegalClaim: max-pooled
novel_content_fraction AUC 0.829 grounded vs misgrounded on expert
labels (n=8 positives - smoke pass, not calibration). Claim
segmentation alone un-inverted the alienness signal; the earlier
negative result was unit mismatch first, reference mismatch second.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 2919b8c1
Stats 3 files changed , +409 , -122
Part of Deterministic legal-text tools ("SLA audit organs")

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-91b58342.md from inside the repo you want the change in.

⬇ Download capture-commit-91b58342.md