Skip to content

Commit 77d0353

Browse files
authored
Merge pull request #170 from interscript/g2b-verdict
docs: G2b verdict — domain-residual attribution rejected
2 parents 3600886 + 5096041 commit 77d0353

1 file changed

Lines changed: 21 additions & 0 deletions

File tree

‎docs/RESULTS.md‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -500,3 +500,24 @@ scratch collapse (74.68) by 0.7pp: data quality and optimization do
500500
NOT rescue 30M from-scratch. Conclusion from evidence: the
501501
"30M-parameter encoder" title claim is closed; the thesis repositions
502502
per PAPER-ALIGNMENT.md.
503+
504+
## ara-diac-small-2-6ep-tashkeela (G2b) — full-set 4.8231: the add-direction test is FLAT-NEGATIVE (2026-09-04)
505+
506+
The domain-residual causal test (TODO.publish-client 01): the G2a
507+
recipe with the FULL cleaned Tashkeela corpus added (5x classical
508+
coverage, 48k units, 39,018 steps, final CE ~0.002). Full 1,200-para
509+
gate: teacher in-run 2.289, student **4.8231**, paired bootstrap delta
510+
2.3717 [2.194, 2.554], p=0 — vs G2a's 4.5701 [1.91, 2.35]. The point
511+
estimate moved the WRONG direction by 0.25pp with overlapping CIs:
512+
statistically flat. Gate (>=0.5pp improvement) FAILED.
513+
514+
Verdict: combined with E6 (register swap at constant budget, -0.98pp),
515+
BOTH directions of the classical-corpus manipulation fail to close the
516+
residual — the student-tier gap is NOT a classical-domain coverage
517+
deficit. The domain-coverage attribution is rejected in the add
518+
direction and the swap direction; the residual reframes as a
519+
teacher-student interaction the corpus cannot reach (candidate next
520+
levers: on-policy distillation — GKD in flight; label-distribution
521+
effects). G2a (2.1) remains the best student; G2b stands as the
522+
closing negative of the data-side program. Provenance: labels sha256
523+
b59e2f56 (235.0MB).

0 commit comments

Comments
 (0)