Held-out precision: 0.00 -> 1.00 conflict scan, 0.81 -> 0.96 term drift

↗ view on GitHub · Eli Ziff · 2026-07-29 · f0caf4e3

Measured on 147 held-out documents, every conflict-scan finding was
false. Three causes, three guards: a colon in the of-gap opens a labeled
field, not a part-of-whole pair; a percent must sit against the pair it
restates (reach 120 -> 40); a parts column with an unaccounted same-unit
figure before its total abstains as incomplete rather than adopting a
prose figure. Term drift stops comparing meaning-pointers as definition
bodies, skips strict-prefix truncation artifacts, and suppresses
imported-use rows where the document expressly incorporates another
instrument's definitions. The planted PSA defect still surfaces as the
sole finding.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 16225b46
Stats 4 files changed , +257 , -18
Part of Deterministic legal-text tools ("SLA audit organs")

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-f0caf4e3.md from inside the repo you want the change in.

⬇ Download capture-commit-f0caf4e3.md