Skip to content

Commit 527ecdd

Browse files
ronaldtseRonald Tse
andauthored
docs: verdict wave 4 — OOD 10.13, capacity closed AR, audio alignment GO (#285)
Co-authored-by: Ronald Tse <ronald.tse@gmail.com>
1 parent 591cfe2 commit 527ecdd

2 files changed

Lines changed: 26 additions & 2 deletions

File tree

‎TODO.sota/00-README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -62,8 +62,8 @@ hf jobs run --flavor a100-large -d \
6262
| 22 | 22-runtime-releases.md | P1 | 14 | PREPARED — owner-gated versions |
6363
| 23 | 23-ort-alignment.md | P1 | 18 | CLOSED — characterization complete; 3-leg parity GREEN at documented bound |
6464
| 24 | 24-verdict-wave.md | P1 | 17 | r8a/b/c + run-026 + thai CLOSED; r8d (knee) RUNNING |
65-
| 25 | 25-ar-news-specialist.md | P1 | 17 | RUNNING (run-029, register-pure full scale) |
66-
| 27 | 27-ar-large-id-arm.md | P1 | — | RUNNING (run-031, byt5-large dedicated, r5 corpus) |
65+
| 25 | 25-ar-news-specialist.md | P1 | 17 | VERDICT: OOD 10.13/8.98 (crown), ID 5.50; export staged |
66+
| 27 | 27-ar-large-id-arm.md | P1 | — | NEGATIVE — 2.5765 parity with r7; capacity closed on AR too |
6767
| 28 | 28-oracle-complementarity.md | P2 | — | CLOSED — ceiling 96.78 real; naive voting catastrophic |
6868
| 26 | 26-heb-noisy-student.md | P1 | 04 | stage 1 RUNNING (labeling); stage 2 staged |
6969

‎docs/RESULTS.md‎

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1345,3 +1345,27 @@ specialist doctrine now holds in BOTH model families and BOTH spaces:
13451345
register silver buys OOD and costs ID, monotonically, everywhere
13461346
measured. Stageable candidate: ara-diac-plane-news-1.0 (4.40 ID still
13471347
beats the old small-tier rung 4.57; OOD −3.14) — owner decision.
1348+
1349+
## SOTA verdict wave 4 — OOD crown 10.13; capacity closed on Arabic too; audio alignment GO (2026-10-09)
1350+
1351+
**run-029 (news specialist, register-pure, 900K QCRI silver units,
1352+
2ep)**: WikiNews-2024 multiref **10.13 / 8.98** (r8b: 11.03/9.24; r7
1353+
baseline: 17.38/11.83 — a **7.25-WER move in 48h**), SadeedDiac-25
1354+
Total DER 5.5008 (specialist doctrine: ID reported as-is). Export
1355+
staged as ara-diac-news-1.0 (IMF v1, int8).
1356+
1357+
**run-031 (byt5-large dedicated, r5 corpus)**: Sadeed **2.5765** /
1358+
morph 1.5279 vs r7's 2.2864/1.5317 — PARITY, not a win. Capacity is
1359+
now closed on BOTH languages: data/curriculum is the binding
1360+
constraint everywhere measured (Hebrew large: 8.48; Arabic large:
1361+
2.58).
1362+
1363+
**WO09 stage 2: GO.** Median phoneme PER **0.395** vs the 0.45 gate
1364+
(after fixing two probe bugs: FLEURS matching needs the
1365+
extension-included filename column; scoring must compare per-PHONE
1366+
tokens, not per-word). ASR phoneme supervision aligns with our
1367+
plane+rules reference chain — the ReNikud-style campaign is
1368+
unblocked end-to-end: $0.28/audio-hour labeling + viable alignment.
1369+
1370+
**WO26 stage 2 RUNNING** (run-030: gold v4 50K + 40K hewiki
1371+
plane-2.0-labeled windows, byt5-base, 3ep; gate < 8.18).

0 commit comments

Comments
 (0)