Stage 13 + Stage 14 pilot results; harden LegalBench quote locator
Stage 13 ladder verdict: sol no-sub falls monotonically with effort (7/18 to 2/18) but effort buys typed honesty, not passes; luna saturates at medium; every residual bail in every strong lane is a CLERC continuation cell. sol@medium crowned; max effort retired for grounding runs. Attrition 1/141. Stage 14 pilot (32 real-contract tests, luna@medium): answered-only char precision 0.44-0.66 vs 0.0077 retrieval baseline, zero wrong-document answers, all 30 retrieval-failed cells declined or abstained typed. P1 alarm audited: gate-accepted quote wrapped in curly quote glyphs defeated the exact-indexOf locator; locator now strips wrapping glyphs and falls back to a whitespace/quote-tolerant regex with exact offsets. P4 volume prediction falsified (quotes cover the gold span; that is the point). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | cdb7afca |
| Stats | 2 files changed , +138 , -16 |
| Part of | Legal grounding and retrieval research |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-880287eb.md
from inside the repo you want the change in.