Stage 21 addendum: the second frozen pairing disagrees with the first

↗ view on GitHub · Eli Ziff · 2026-07-31 · 8ddf101f

Receipts finished filling before the chains stopped (1,093 scored cells,
up from 881). The extra rows are all post-drift, so the first pinned
subset is unchanged, but the later schemas now form a second and larger
internally-consistent pairing - legacy 2671ch x address 5031ch, the
CURRENT definitions on the tree, paired n=186 asis.

It disagrees with the first. f1_best +0.0231 [0.0070, 0.0426] becomes
+0.0013 [-0.0211, 0.0269]; reached_by_read +0.1000 [0.0200, 0.1827]
becomes -0.0269 [-0.0867, 0.0391]. Neither pairing's f1_best clears its
within-arm replicate floor, so the honest reading of both together is
no demonstrated quality effect, and the early positive is a small-n
fluctuation rather than something a later revision erased.

Corrects the correction: it said the disqualification trigger does not
fire on the registered arms. That holds for the EARLY pairing only. On
the current arms the trigger fires robustly on the largest frozen
subset - reached_any -0.1774 [-0.2251, -0.1315], reached_all -0.2849 -
and is recorded as fired. As before the metric is unresolvable at this
n: arm B's own replicate floor on reached_any is 0.2391, larger than
the gap.

The one effect that is real on the current arms is exposure:
chars_exposed -9,789 [-12727, -7075] against floors of 2,556 and 5,638.
The current arm B reads about a quarter as much document (3,344 vs
13,133 chars) for statistically identical answer quality, which is
exactly why reached_any falls while reached_by_read stays flat. Arm B
is also slower (+1,383 ms).

Unchanged across both pairings and now 2,941 tool calls: library_links
0 calls, follow walked the graph 0 times in 597 find calls, page
addressing 0, off-schema usage 0.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H9ToHYJVDxfeJcJwdzrP2H
Repository eliziff/Beaver
Author Eli Ziff <eliasziff@gmail.com>
Authored
Parents 31ae135b
Stats 1 file changed , +69
Part of Legal agent-surface and context-compaction experiments

Capture this commit into my fork

Download a Markdown prompt that tells Claude how to port this exact commit into your working tree. Run it via claude -p < capture-commit-8ddf101f.md from inside the repo you want the change in.

⬇ Download capture-commit-8ddf101f.md