File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -217,6 +217,7 @@ The viable path to a sub-100MB browser tier is width reduction FROM a
217217pretrained ByT5-small (closed-form stitch across widths, microkimi
218218protocol), not from-scratch training.
219219
220+ [ CORRECTED 2026-09-05: the 4.8218 figure below did not reproduce; the corrected 2.0 number is 5.08 (see the correction entry above).]
220221## ara-diac-small-1.0 — Arabic client tier (2026-08-24)
221222
222223Sequence-level KD from the r6 teacher (rababa_arabic_byt5/run-006-morph,
Original file line number Diff line number Diff line change @@ -6,10 +6,12 @@ architecture and artifact size as 1.0: the **r7 canonical teacher**
66(2.2864; fresh greedy labels) and the ** Muon optimizer** (E3-adopted).
77
88- 1.0 (r6 labels, AdamW): 8.26 full-set windowed DER-CE
9- - 2.0 (r7 labels, Muon): ** 4.82** (teacher r7 in-run: 2.289)
9+ - 2.0 (r7 labels, Muon): ** 5.08** (teacher r7 in-run: 2.289; corrected
10+ 2026-09-05 — the first-published 4.82 did not reproduce, see
11+ docs/RESULTS.md)
1012
1113A 42% error reduction, pre-registered as E4 (gate ≤ 6.26; prediction
12- 4.3–5.0 — landed at 4.82 ). The strict teacher+0.5pp gate is still
14+ 4.3–5.0 — landed at 5.08 after the 2026-09-05 correction ). The strict teacher+0.5pp gate is still
1315missed (+2.53pp, disclosed); the E2/E3 factorial attributes the
1416residual to domain coverage. Identical IMF v1 contract: dynamic fetch,
1517sha256-verified, KV decode, margins JSON alongside.
Original file line number Diff line number Diff line change @@ -12,7 +12,7 @@ trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_by
1212 2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units
1313 corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small
1414 (E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-006-r7-muon/best.
15- The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher
15+ The two measured wins compound: 8.259 -> 5.0821 full-set windowed DER-CE (corrected 2026-09-05 (teacher
1616 reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0
1717 release at the same architecture and artifact size. Still misses the strict teacher+0.5pp
1818 gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain
@@ -25,7 +25,7 @@ metrics:
2525 the documented 2.2864 (r7 canonical teacher)
2626 source : interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
2727- name : der_student_fullset
28- value : 4.8218
28+ value : 5.0821
2929 protocol : same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small)
3030 vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical
3131 architecture and artifact size
You can’t perform that action at this time.
0 commit comments