docs(lab): reqecho null across all 3 delivery modes on tax - auto-echo 48, draft-mode 42, roundtrip 47 (no-echo mean 45.9)
Fix A (auto-echo, no fetch_requirements roundtrip) and Fix B
(drafting mode, echo before any body captured) both verified live
(echo_call_count=1 each) and judged concurrently on deepseek-v4-flash:
48/77 and 42/77, both inside the no-echo band {38..53}. Roundtrip
was never the problem; the 202-char generic payload has nothing to
steer. Reqecho thread closed on tax.
Co-Authored-By: Claude <noreply@anthropic.com>
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | 7b820b94 |
| Stats | 1 file changed , +44 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-37585b6e.md
from inside the repo you want the change in.