The single-space extraction dialect, recovered by its antecedent

↗ view on GitHub · Eli Ziff · 2026-07-31 · 191c512f

The rejected hypothesis from the previous commit, retried with the guard it
was missing. Offering a line start before any head-shaped token minted a
section out of every entry in a definitions index - "'Balance Sheet Date'
has the meaning set forth in Section 6.16(a)" - and CAI International went
to 272 heads against roughly 100 real ones.

What separates a lost line break from an ordinary space is what precedes it,
not what follows. A heading begins after the END of the previous line, so in
a single-space join the character before the lost newline is a sentence
terminator. "set forth in Section 6.16" is preceded by "in", and that is the
whole difference. The guard collapses the pathology exactly: CAI holds at 26
heads, not 272.

Corpus numbers, mini (before -> after this commit): documents refused 19 ->
16, references resolved 3,891 -> 4,414, accepted references that miss 10.6%
-> 9.1%. At Home Group 33 -> 96 heads and integrity 0.39 -> 0.90;
BioTelemetry, already accepted, 0.75 -> 0.93 and 296 -> 434 resolved;
ABILITYINC 0.33 -> 0.92; ASIANDRAGON 0.00 -> 0.75. No document went from
accepted to refused, and detected (9,234) and external (1,720) are still
unchanged from the 2d903c82 baseline - no reference grammar has moved
through any of this.

Whole round against the recorded baseline: refused 24 -> 16, resolved 2,428
-> 4,414 (+82%), miss rate 11.2% -> 9.1%. Per source refused: maud 8 -> 4,
cuad 7 -> 3, contractnli 3 -> 3, privacy_qa 6 -> 6.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H9ToHYJVDxfeJcJwdzrP2H
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents f0f675ee
Stats 3 files changed , +135 , -16
Part of SourceDoc / DOCX engine: redlines, tracked changes, editing benchmark

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-191c512f.md from inside the repo you want the change in.

⬇ Download capture-commit-191c512f.md