Skip to content

Commit 0581cc8

Browse files
authored
Merge pull request #161 from interscript/release/ara-diac-layerdrop-1.0
release: ara-diac-layerdrop-1.0
2 parents df9225a + 12b7406 commit 0581cc8

2 files changed

Lines changed: 29 additions & 11 deletions

File tree

‎models.yaml‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -317,3 +317,16 @@ models:
317317
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
318318
parity: {samples: 2480, cer_delta: 0.0857}
319319
license: BSD-3-Clause
320+
ara-diac-layerdrop-1.0:
321+
task: diacritization
322+
scripts: [Arab, Arab]
323+
precision: fp32
324+
filename: ld-fp32.zip
325+
url: https://github.com/interscript/interscript-ml/releases/download/ara-diac-layerdrop-1.0/ld-fp32.zip
326+
sha256: 8f297bdc0e7eba5160c6ed8a2a437abbd399687fd14f2f2b640a4b4c639a3d16
327+
size: 1015218371
328+
metrics:
329+
- {name: der_teacher_fullset, value: 2.2921, source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep}
330+
- {name: der_student_fullset, value: 5.784, source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep}
331+
parity: {samples: 2480, cer_delta: 0.0632}
332+
license: BSD-3-Clause

‎models/ara-diac-layerdrop/ara-diac-layerdrop-1.0.metadata.yaml‎

Lines changed: 16 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -8,23 +8,28 @@ opset: 14
88
decoder: kv
99
precision: fp32
1010
license: BSD-3-Clause
11-
trained_from: 'the depth-cut rung: ByT5-small with the encoder halved
12-
12->6 (surviving layers copied VERBATIM from pretraining - both width-cut
13-
approaches collapsed at 74.68/82.96 while this works), Muon optimizer, r7
14-
teacher labels (the 2.0 recipe), 6 epochs. ~190M parameters (63% of
15-
ByT5-small). Full-set windowed DER-CE 5.784, delta CI [3.033, 3.491] vs
16-
in-run teacher 2.2921 — the depth premium over the full-depth G2a peer
17-
(4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals.
18-
The int4 variant (~95MB) is the browser-budget tier; margin-gated before
19-
ship. Checkpoint
11+
trained_from: 'the depth-cut rung: ByT5-small with the encoder halved 12->6 (surviving
12+
layers copied VERBATIM from pretraining - both width-cut approaches collapsed at
13+
74.68/82.96 while this works), Muon optimizer, r7 teacher labels (the 2.0 recipe),
14+
6 epochs. ~190M parameters (63% of ByT5-small). Full-set windowed DER-CE 5.784,
15+
delta CI [3.033, 3.491] vs in-run teacher 2.2921 — the depth premium over the full-depth
16+
G2a peer (4.5701, CI [1.911, 2.352]) is 1.21pp with non-overlapping intervals. The
17+
int4 variant (~95MB) is the browser-budget tier; margin-gated before ship. Checkpoint
2018
rababa-checkpoints:/rababa_arabic_distill_small/run-009-layerdrop-6ep/best.'
2119
metrics:
2220
- name: der_teacher_fullset
2321
value: 2.2921
24-
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy,
25-
haraqat-projected, Misraj evaluator); full 1,200-paragraph SadeedDiac-25
22+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
23+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25
2624
source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
2725
- name: der_student_fullset
2826
value: 5.784
2927
protocol: same harness; paired bootstrap delta 3.2455 [3.033, 3.491]
3028
source: interscript/interscript-ml docs/RESULTS.md#layerdrop-6ep
29+
parity:
30+
samples: 2480
31+
cer_delta: 0.0632
32+
sha256:
33+
decoder-kv.onnx: 6174f11ccd1f328390df17fe2e8a66e794d14e01ceed8fae85d8b590366f30a8
34+
decoder.onnx: 1662fb55fe99a0c83da8e0f96418518da944f7c6d8c7f15bf589a9c078540271
35+
encoder.onnx: 22a2b1477afab2f033ced9f9f21732e71e2717821d7e251936d52e8c06a4d6ea

0 commit comments

Comments
 (0)