Stage 18 F1 result: name-stripped retrieval collapses (docR 1.00->0.71, poolR48 0.89->0.37)

↗ view on GitHub · Eli Ziff · 2026-07-31 · 62d614ab

Registered prediction confirmed ~3x over: the crowned retrieval numbers
are substantially a query-format artifact (queries name their gold
document). Reported, no gate, per registration.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H9ToHYJVDxfeJcJwdzrP2H
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 49107804
Stats 1 file changed , +32
Part of Legal grounding and retrieval research

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-62d614ab.md from inside the repo you want the change in.

⬇ Download capture-commit-62d614ab.md