grounding: H13 external validation - negative result, scope narrowed
RegLab expert-labeled slice (174 grounded vs 32 misgrounded/ungrounded real tool responses): word-trigram alienness INVERTED (AUC 0.372), prompt-share chance (0.550). Diagnosis recorded before any threshold ships: reference mismatch (grounded US responses quote US statutes - maximally alien to the Canadian reference; jurisdiction-matched references required), unit mismatch (claim-calibrated signal scored on full responses; segment first), and a scope boundary - RegLab misgrounding is largely RELATIONAL (real citation, plausible register, wrong support), invisible to lexical lint and precisely the H12 stands-for machinery target. H13 stands as claim-level, same-jurisdiction composed-overreach screening only. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012AgUm5EcRKbT3duVFMbrQD
| Repository | eliziff/Beaver |
|---|---|
| Author | Eli Ziff <eliasziff@gmail.com> |
| Authored | |
| Parents | 1d322317 |
| Stats | 1 file changed , +18 |
| Part of | Legal grounding and retrieval research |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-cc5c13b7.md
from inside the repo you want the change in.