From 94cd969f6e0da48a500cbfeede58c42c56997379 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Fri, 9 Oct 2026 09:12:32 +0800 Subject: [PATCH] =?UTF-8?q?docs:=20WO26=20negative=20=E2=80=94=208.72=20vs?= =?UTF-8?q?=208.18;=20Hebrew=20text=20levers=20exhausted,=20audio=20remain?= =?UTF-8?q?s?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- TODO.sota/00-README.md | 2 +- docs/RESULTS.md | 11 +++++++++++ 2 files changed, 12 insertions(+), 1 deletion(-) diff --git a/TODO.sota/00-README.md b/TODO.sota/00-README.md index 9803bdc4..d3829abd 100644 --- a/TODO.sota/00-README.md +++ b/TODO.sota/00-README.md @@ -66,7 +66,7 @@ hf jobs run --flavor a100-large -d \ | 27 | 27-ar-large-id-arm.md | P1 | — | NEGATIVE — 2.5765 parity with r7; capacity closed on AR too | | 28 | 28-oracle-complementarity.md | P2 | — | CLOSED — ceiling 96.78 real; naive voting catastrophic | | 30 | 30-heb-learned-ipa-v0.md | P1 | 09 | RUNNING (run-032, FLEURS audio-supervised student) | -| 26 | 26-heb-noisy-student.md | P1 | 04 | stage 1 RUNNING (labeling); stage 2 staged | +| 26 | 26-heb-noisy-student.md | P1 | 04 | NEGATIVE — 8.72 vs 8.18; all three text levers closed | ## Schedule diff --git a/docs/RESULTS.md b/docs/RESULTS.md index 9ea484e5..35bca029 100644 --- a/docs/RESULTS.md +++ b/docs/RESULTS.md @@ -1369,3 +1369,14 @@ unblocked end-to-end: $0.28/audio-hour labeling + viable alignment. **WO26 stage 2 RUNNING** (run-030: gold v4 50K + 40K hewiki plane-2.0-labeled windows, byt5-base, 3ep; gate < 8.18). + +## WO26 verdict — Hebrew noisy student NEGATIVE: 8.72 vs crown 8.18 (2026-10-09) + +run-030 (gold v4 50K + 40K hewiki plane-2.0-labeled windows, byt5-base, +3ep, K=3): in-job nakdimon DER **8.72** — worse than the shipped +heb-diac-plane-2.0 (8.18). The self-labeled wiki text reinforces the +teacher's own errors rather than adding signal. Hebrew state after +three closed levers: crown **8.18** (data scale ✗ at 50K→90K, capacity +✗ byt5-large 8.48, noisy-student ✗ 8.72). The remaining Hebrew lever +is the AUDIO campaign — WO30 v0 student RUNNING now on the GO-grade +supervision.