@@ -1397,3 +1397,25 @@ NOT triggered — scaling a weak teacher wastes it. The audio path
13971397remains open but requires: fine-tune the phoneme CTC on Hebrew audio
13981398(FLEURS he ~ 10h is exactly that training set), then relabel, then
13991399v1. Spec'd as WO31; needs owner green-light for the next compute block.
1400+
1401+ ## The "same corpus must win" program — convergence CLOSED, both matched arms in flight (2026-10-09)
1402+
1403+ ** Contamination audit: CLEAN** — 0/356 WikiNews-2024 test sentences
1404+ share even one 8-gram with the QCRI 5M-word corpus; their 2.70 is
1405+ honest generalization, ours is too. ** run-029c (+2 epochs, seq2seq
1406+ specialist): 10.03/8.95** (from 10.13) — the seq2seq line has
1407+ CONVERGED; doubling training bought 0.10 WER. The remaining 7.3-point
1408+ gap is therefore ARCHITECTURE (tagging vs generation) + teacher quality,
1409+ and two arms now attack it directly on their exact recipe:
1410+
1411+ - ** run-033** (byt5-large PLANE = our tagging family + full 900K-unit
1412+ corpus, news-pure, 3ep, K=3, gradient checkpointing) — their class
1413+ with a far stronger backbone.
1414+ - ** run-034** (literal BiLSTM tagger, Fadel/QCRI-style: char-emb →
1415+ 3×BiLSTM-512 → per-position haraqat head, from scratch, same corpus)
1416+ — their architecture, rebuilt and run at our data scale.
1417+
1418+ Fixes en route (train #128 -#131 ): haraqat split_planes mark-only crash
1419+ (QCRI silver has pure-combining-mark windows — latent library bug, now
1420+ tested); byt5-large OOM → PLANE_CHECKPOINT gradient checkpointing;
1421+ LSTM OOM → BIL_BS; padded-label loss smearing → ignore_index=-100.
0 commit comments