grounding: C2 attestation configuration decided - word-trigrams win

↗ view on GitHub · Eli Ziff · 2026-07-30 · 140f0bd2

Three-way calibration over 553 labeled claims under the pre-stated
rule: word-trigram unattested share (AUC 0.694) beats every tokengrams
stream configuration at the current reference scale - char n=12..24
plateau at 0.677-0.640, GPT-2 token n=3..8 at 0.646-0.588, and the
QUIP-canonical char n=30/50 SATURATE (~100% unattested for accepted
and rejected alike): our 230M-char reference sits ~4 orders below the
web-scale corpora that configuration presumes, so contrast lives at
coarse word granularity. Engine (tokengrams) settled regardless; queued
follow-ups: u32 word-id stream so the winning signal serves from the
base engine (retiring the hand-rolled sqlite), and a full-corpus
reference rebuild + re-test, since reference size binds the finer
signals. Breadth-corpus re-test still gates production thresholds.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 85b7601f
Stats 1 file changed , +20
Part of Legal grounding and retrieval research

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-140f0bd2.md from inside the repo you want the change in.

⬇ Download capture-commit-140f0bd2.md