feat(eval): deepseek judge lane via OpenAI-compatible chat-completions
deepseek-* judge models ride openai.OpenAI(base_url=DEEPSEEK_BASE_URL or https://api.deepseek.com, key=DEEPSEEK_API_KEY) with a dedicated chat-completions evaluator (deepseek has no Responses API): JSON mode on all attempts but the last, shared _parse_json verdict extraction. Judge lane directive (Eli, 2026-08-06): judge with deepseek-v4-flash from here on; claude-judged legacy rows stay as their own stratum. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_011pfUVhNFTRvhYGXBwoKNj6
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | b7dd1492 |
| Stats | 1 file changed , +43 |
| Part of | Evaluation harness: Beaver-CAN and LegalBench-RAG adapters |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-abef7522.md
from inside the repo you want the change in.