docs(lab): speed axis on real-estate pair - lean 237s vs native 528s (~2.2x faster)
Native emits 3.2x more output tokens (82.6k vs 25.6k) at a higher per-second rate (156 vs 108 out/s), so more tokens still wins out: 8.8min vs 4.0min wall. Real-estate pair now: same score 67/75, ~2x cheaper, ~2.2x faster.
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | e1f5a0b7 |
| Stats | 1 file changed , +1 , -1 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-79d570f7.md
from inside the repo you want the change in.