From 5cf0ce035d7f9ebd38e8884e048f6a13748ec2ed Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Fri, 9 Oct 2026 06:47:23 +0800 Subject: [PATCH] =?UTF-8?q?docs:=20verdict=20wave=204=20=E2=80=94=20OOD=20?= =?UTF-8?q?10.13,=20capacity=20closed=20AR,=20audio=20alignment=20GO?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- TODO.sota/00-README.md | 4 ++-- docs/RESULTS.md | 24 ++++++++++++++++++++++++ 2 files changed, 26 insertions(+), 2 deletions(-) diff --git a/TODO.sota/00-README.md b/TODO.sota/00-README.md index 7944f77..0133b68 100644 --- a/TODO.sota/00-README.md +++ b/TODO.sota/00-README.md @@ -62,8 +62,8 @@ hf jobs run --flavor a100-large -d \ | 22 | 22-runtime-releases.md | P1 | 14 | PREPARED — owner-gated versions | | 23 | 23-ort-alignment.md | P1 | 18 | CLOSED — characterization complete; 3-leg parity GREEN at documented bound | | 24 | 24-verdict-wave.md | P1 | 17 | r8a/b/c + run-026 + thai CLOSED; r8d (knee) RUNNING | -| 25 | 25-ar-news-specialist.md | P1 | 17 | RUNNING (run-029, register-pure full scale) | -| 27 | 27-ar-large-id-arm.md | P1 | — | RUNNING (run-031, byt5-large dedicated, r5 corpus) | +| 25 | 25-ar-news-specialist.md | P1 | 17 | VERDICT: OOD 10.13/8.98 (crown), ID 5.50; export staged | +| 27 | 27-ar-large-id-arm.md | P1 | — | NEGATIVE — 2.5765 parity with r7; capacity closed on AR too | | 28 | 28-oracle-complementarity.md | P2 | — | CLOSED — ceiling 96.78 real; naive voting catastrophic | | 26 | 26-heb-noisy-student.md | P1 | 04 | stage 1 RUNNING (labeling); stage 2 staged | diff --git a/docs/RESULTS.md b/docs/RESULTS.md index 74c0055..9ea484e 100644 --- a/docs/RESULTS.md +++ b/docs/RESULTS.md @@ -1345,3 +1345,27 @@ specialist doctrine now holds in BOTH model families and BOTH spaces: register silver buys OOD and costs ID, monotonically, everywhere measured. Stageable candidate: ara-diac-plane-news-1.0 (4.40 ID still beats the old small-tier rung 4.57; OOD −3.14) — owner decision. + +## SOTA verdict wave 4 — OOD crown 10.13; capacity closed on Arabic too; audio alignment GO (2026-10-09) + +**run-029 (news specialist, register-pure, 900K QCRI silver units, +2ep)**: WikiNews-2024 multiref **10.13 / 8.98** (r8b: 11.03/9.24; r7 +baseline: 17.38/11.83 — a **7.25-WER move in 48h**), SadeedDiac-25 +Total DER 5.5008 (specialist doctrine: ID reported as-is). Export +staged as ara-diac-news-1.0 (IMF v1, int8). + +**run-031 (byt5-large dedicated, r5 corpus)**: Sadeed **2.5765** / +morph 1.5279 vs r7's 2.2864/1.5317 — PARITY, not a win. Capacity is +now closed on BOTH languages: data/curriculum is the binding +constraint everywhere measured (Hebrew large: 8.48; Arabic large: +2.58). + +**WO09 stage 2: GO.** Median phoneme PER **0.395** vs the 0.45 gate +(after fixing two probe bugs: FLEURS matching needs the +extension-included filename column; scoring must compare per-PHONE +tokens, not per-word). ASR phoneme supervision aligns with our +plane+rules reference chain — the ReNikud-style campaign is +unblocked end-to-end: $0.28/audio-hour labeling + viable alignment. + +**WO26 stage 2 RUNNING** (run-030: gold v4 50K + 40K hewiki +plane-2.0-labeled windows, byt5-base, 3ep; gate < 8.18).