@@ -8,23 +8,28 @@ opset: 14
88decoder : kv
99precision : fp32
1010license : BSD-3-Clause
11- trained_from : ' the depth-cut rung: ByT5-small with the encoder halved
12- 12->6 (surviving layers copied VERBATIM from pretraining - both width-cut
13- approaches collapsed at 74.68/82.96 while this works), Muon optimizer, r7
14- teacher labels (the 2.0 recipe), 6 epochs. ~190M parameters (63% of
15- ByT5-small). Full-set windowed DER-CE 5.784, delta CI [3.033, 3.491] vs
16- in-run teacher 2.2921 — the depth premium over the full-depth G2a peer
17- (4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals.
18- The int4 variant (~95MB) is the browser-budget tier; margin-gated before
19- ship. Checkpoint
11+ trained_from : ' the depth-cut rung: ByT5-small with the encoder halved 12->6 (surviving
12+ layers copied VERBATIM from pretraining - both width-cut approaches collapsed at
13+ 74.68/82.96 while this works), Muon optimizer, r7 teacher labels (the 2.0 recipe),
14+ 6 epochs. ~190M parameters (63% of ByT5-small). Full-set windowed DER-CE 5.784,
15+ delta CI [3.033, 3.491] vs in-run teacher 2.2921 — the depth premium over the full-depth
16+ G2a peer (4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals. The
17+ int4 variant (~95MB) is the browser-budget tier; margin-gated before ship. Checkpoint
2018 rababa-checkpoints:/rababa_arabic_distill_small/run-009-layerdrop-6ep/best.'
2119metrics :
2220- name : der_teacher_fullset
2321 value : 2.2921
24- protocol : windowed DER-CE (1400-byte windows, word-boundary split, greedy,
25- haraqat-projected, Misraj evaluator); full 1,200-paragraph SadeedDiac-25
22+ protocol : windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
23+ Misraj evaluator); full 1,200-paragraph SadeedDiac-25
2624 source : interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
2725- name : der_student_fullset
2826 value : 5.784
2927 protocol : same harness; paired bootstrap delta 3.2455 [3.033, 3.491]
3028 source : interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
29+ parity :
30+ samples : 2480
31+ cer_delta : 0.0632
32+ sha256 :
33+ decoder-kv.onnx : 6174f11ccd1f328390df17fe2e8a66e794d14e01ceed8fae85d8b590366f30a8
34+ decoder.onnx : 1662fb55fe99a0c83da8e0f96418518da944f7c6d8c7f15bf589a9c078540271
35+ encoder.onnx : 22a2b1477afab2f033ced9f9f21732e71e2717821d7e251936d52e8c06a4d6ea
0 commit comments