diff --git a/TODO.sota/00-README.md b/TODO.sota/00-README.md index 8e59e0e..0b54c80 100644 --- a/TODO.sota/00-README.md +++ b/TODO.sota/00-README.md @@ -57,10 +57,11 @@ hf jobs run --flavor a100-large -d \ | 17 | 17-arabic-register-closure.md | P1 | 11 | r8a RUNNING; r8b launching | | 18 | 18-parity-runs.md | P1 | 10 | pending | | 19 | 19-lexicon-loader.md | P2 | 13 | DONE (py#33) | -| 20 | 20-hebrew-large-arm.md | P1 | 04 | RUNNING (run-026, byt5-large/K=4) | -| 21 | 21-arabic-plane-transfer.md | P2 | 17 | pending verdict | +| 20 | 20-hebrew-large-arm.md | P1 | 04 | NEGATIVE — 8.48 vs base 8.18; base stays shipped | +| 21 | 21-arabic-plane-transfer.md | P2 | 17 | pending r8b/r8c verdicts | | 22 | 22-runtime-releases.md | P1 | 14 | PREPARED — owner-gated versions | | 23 | 23-ort-alignment.md | P1 | 18 | CLOSED — characterization complete; 3-leg parity GREEN at documented bound | +| 24 | 24-verdict-wave.md | P1 | 17 | r8a + run-026 verdicts in; r8b/r8c/thai3 pending | ## Schedule diff --git a/TODO.sota/24-verdict-wave.md b/TODO.sota/24-verdict-wave.md new file mode 100644 index 0000000..443b371 --- /dev/null +++ b/TODO.sota/24-verdict-wave.md @@ -0,0 +1,14 @@ +# WO24 — r8 verdict processing + the dose-response question + +In flight: r8b (QCRI 33% dose) and r8c (both) — dual-surface gates +running; thai tiny3 resumed from student.pt (decode-only, ~20 min). + +WO17's r8a result reframes the arms: news-register silver MOVES OOD +(-0.67 WER at a 2.7% dose) but costs ID (+0.62 DER). The remaining +question is the DOSE-RESPONSE: if r8b/r8c also regress ID, the +follow-up (r8d) is a gentle arm — silver capped at 5% of gold tokens, +lr 3e-5, r7-init — targeting OOD improvement with ID held. Ship rule +unchanged: dominance on BOTH surfaces or documented negative. + +Also pending: run-026 negative recorded (base stays shipped); +thai tiny3 verdict → WO12 contract or closure.