Pre-pilot fairness audit: hold everything but the harness constant
Runner parity fixes: explicit reasoning_effort (medium) on the /chat body matching Arm A, and Beaver online research tools (CourtListener, A2AJ, public-legal) stripped from the advertised list so information access matches Arm A sealed --network=none sandbox; removal recorded in receipts. PROTOCOL.md gains the verified held-constant list, harness-intrinsic differences, and residual disclosures. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016yXxuitxX5h4wm1v88hnga
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | cc97d477 |
| Stats | 2 files changed , +69 , -1 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-df13d3d9.md
from inside the repo you want the change in.