Stage 21 harness: interleave work across sources; affordance uptake table
The sample is stratified but sorted by test id, so a condition that stopped early left a source-ORDERED prefix - all contractnli, no privacy_qa - which is no longer a stratified sample. Work is now round-robined across the four sources, so every prefix stays balanced and an interrupted condition remains usable. Report gains an arm-B affordance uptake table with the denominators that make a zero meaningful (offered and declined, not absent), plus reached_by_read in the per-source and per-size-band breakdowns. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01H9ToHYJVDxfeJcJwdzrP2H
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | 6a6edacd |
| Stats | 1 file changed , +35 , -3 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-c6996918.md
from inside the repo you want the change in.