Skip to content

Commit 5a9fcc2

Browse files
author
Ronald Tse
committed
release: ara-diac-small-2.1-int8 (int8, parity cer_delta 0.0857pp on 2480 samples)
1 parent a329bb6 commit 5a9fcc2

2 files changed

Lines changed: 52 additions & 0 deletions

File tree

‎models.yaml‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -292,3 +292,16 @@ models:
292292
- {name: der_wikinews_multiref, value: 11.8273, source: rababa/docs/RESULTS.md#r7-ood-verdict-table-wikinews-2024-multiref-2026-08-28}
293293
parity: {samples: 600, cer_delta: 0.0947}
294294
license: BSD-3-Clause
295+
ara-diac-small-2.1-int8:
296+
task: diacritization
297+
scripts: [Arab, Arab]
298+
precision: int8
299+
filename: ara-diac-small-2.1-int8.zip
300+
url: https://github.com/interscript/interscript-ml/releases/download/ara-diac-small-2.1/ara-diac-small-2.1-int8.zip
301+
sha256: 9b4e4aad2ab53a8cfbec432a78e27b409376627243aec3fd043f06574552a32b
302+
size: 267965657
303+
metrics:
304+
- {name: der_teacher_fullset, value: 2.289, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
305+
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
306+
parity: {samples: 2480, cer_delta: 0.0857}
307+
license: BSD-3-Clause
Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
format: imf-v1
2+
id: ara-diac-small-2.1
3+
task: diacritization
4+
source_script: Arab
5+
target: Arab
6+
tokenizer: bytes
7+
opset: 14
8+
decoder: kv
9+
precision: int8
10+
license: BSD-3-Clause
11+
trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_byt5/run-007-news/best,
12+
2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units
13+
corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small
14+
(E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-007-r7-muon-6ep/best.
15+
The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher
16+
reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0
17+
release at the same architecture and artifact size. Still misses the strict teacher+0.5pp
18+
gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain
19+
coverage.'
20+
metrics:
21+
- name: der_teacher_fullset
22+
value: 2.289
23+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
24+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25; in-run reproduction of
25+
the documented 2.2864 (r7 canonical teacher)
26+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
27+
- name: der_student_fullset
28+
value: 4.5701
29+
protocol: same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small)
30+
vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical
31+
architecture and artifact size
32+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
33+
parity:
34+
samples: 2480
35+
cer_delta: 0.0857
36+
sha256:
37+
decoder-kv.onnx: 7fe2953bafb0955986b2ce2036da6077df5b7f1d9a9295265a1aa24b85961813
38+
decoder.onnx: affcca046189862be499aa6ce0d724a71d40507bd418882241d51cf6a277707a
39+
encoder.onnx: 61afa9ded2e61966a2966f906650715183f95cccc24bac699ed4c4b2d766eecd

0 commit comments

Comments
 (0)