Stage 18 CRITICAL: CRLF gold-coordinate defect - all maud scores wrong; fused flips to KEEP
Two independent adversarial audits converged on the same defect and a first-hand minimal repro confirms it: the 17 maud corpus files are CRLF, upstream gold spans are LF coordinates (334/334 match the answer oracle under LF, 0/334 raw). Corrected: ctx maud ansR 0.1385->0.4985, fused 0.1449->0.6057, fused pool R@48 0.635->0.863. Fused grounded confirm flips DROP->KEEP (+0.107 vs +0.02 bar); R4 invalidated; maud-bottleneck narrative was ~65% artifact. Companion findings recorded: composer noise floor (paired 1-sigma 0.0065, gates of 0.01-0.02 inside noise), holdout task-staleness (98-100% template reuse; privacy_qa has NO holdout), bed easiness (doc named in query, doc_hit ~100%), D2-D8 scorer defects. Standing corrections adopted: coordinate-corrected scoring everywhere, C1 judged both ways, fused reinstated as ceiling arm, Stage 19 protocol additions. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01H9ToHYJVDxfeJcJwdzrP2H
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | edabce75 |
| Stats | 1 file changed , +138 |
| Part of | Legal grounding and retrieval research |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-49107804.md
from inside the repo you want the change in.