Skip to content

Commit a510af8

Browse files
author
Ronald Tse
committed
feat(export): ara-diac-small-2.1 — the G2a 6-epoch rung (4.5701)
Same recipe as 2.0 at 6 epochs; epochs alone buy 0.25pp with non-overlapping CIs. Metadata carries the full attribution and the label-provenance note. (TODO.publish-client 03)
1 parent cb7c5a5 commit a510af8

2 files changed

Lines changed: 48 additions & 0 deletions

File tree

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
format: imf-v1
2+
id: ara-diac-small-2.1
3+
task: diacritization
4+
source_script: Arab
5+
target: Arab
6+
tokenizer: bytes
7+
opset: 14
8+
decoder: kv
9+
precision: fp32
10+
license: BSD-3-Clause
11+
trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_byt5/run-007-news/best,
12+
2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units
13+
corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small
14+
(E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-007-r7-muon-6ep/best.
15+
The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher
16+
reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0
17+
release at the same architecture and artifact size. Still misses the strict teacher+0.5pp
18+
gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain
19+
coverage.'
20+
metrics:
21+
- name: der_teacher_fullset
22+
value: 2.289
23+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
24+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25; in-run reproduction of
25+
the documented 2.2864 (r7 canonical teacher)
26+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
27+
- name: der_student_fullset
28+
value: 4.5701
29+
protocol: same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small)
30+
vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical
31+
architecture and artifact size
32+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
33+
parity:
34+
samples: 600
35+
cer_delta: 0.1187
36+
sha256:
37+
decoder-kv.onnx: 61ef645345997eb5b9746ac77b39363228e5d0873093e6ebaca9a5903d3ac846
38+
decoder.onnx: 56d81cc644e2c27b56f5efd07f3e6bac0244b74e1383782b13e2d615fbcd43c6
39+
encoder.onnx: 1eab5f6d418bd718e0628e0cee3124143dd7f277e5b14669a8df76744d12c5ce

‎src/gpu/modal_export.py‎

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -123,6 +123,15 @@
123123
"test_data": "arabic-sadeed-imf/test.jsonl",
124124
"probe": "قوله",
125125
},
126+
"ara-diac-small-21": {
127+
"volume": "/volumes/rababa-checkpoints",
128+
"checkpoint": "rababa_arabic_distill_small/run-007-r7-muon-6ep/best",
129+
"metadata": "models/ara-diac-small/ara-diac-small-2.1.metadata.yaml",
130+
"readme": "models/ara-diac-small/ara-diac-small-2.0.README.md",
131+
"test_volume": "/datasets/rababa",
132+
"test_data": "arabic-sadeed-imf/test.jsonl",
133+
"probe": "قوله",
134+
},
126135
"urd-diac": {
127136
"volume": "/volumes/urdu-diacrit-checkpoints",
128137
"checkpoint": "urdu_diacrit/run-001/best",

0 commit comments

Comments
 (0)