Skip to content

Commit 777932e

Browse files
ronaldtseRonald Tse
andauthored
docs: TODO.sota 25-26 — the SOTA push arms (AR specialist full-scale, HE noisy student) (#280)
Co-authored-by: Ronald Tse <ronald.tse@gmail.com>
1 parent cb2caef commit 777932e

3 files changed

Lines changed: 22 additions & 0 deletions

File tree

‎TODO.sota/00-README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,8 @@ hf jobs run --flavor a100-large -d \
6262
| 22 | 22-runtime-releases.md | P1 | 14 | PREPARED — owner-gated versions |
6363
| 23 | 23-ort-alignment.md | P1 | 18 | CLOSED — characterization complete; 3-leg parity GREEN at documented bound |
6464
| 24 | 24-verdict-wave.md | P1 | 17 | r8a/b/c + run-026 + thai CLOSED; r8d (knee) RUNNING |
65+
| 25 | 25-ar-news-specialist.md | P1 | 17 | RUNNING (run-029, register-pure full scale) |
66+
| 26 | 26-heb-noisy-student.md | P1 | 04 | stage 1 RUNNING (labeling); stage 2 staged |
6567

6668
## Schedule
6769

‎TODO.sota/25-ar-news-specialist.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
# WO25 — Arabic news specialist at full scale (the OOD SOTA play)
2+
3+
RUNNING (run-029, a100-large): register-PURE — NO classical tashkeela —
4+
QCRI silver at full scale (900K units ≈ 4.5M words), 2 epochs, r7-init.
5+
r8b proved 1M words of silver moves OOD 6.35 WER; 4.5x the data and
6+
zero register dilution is the honest shot at their 2.70 (in-domain for
7+
them, trained on the same corpus family).
8+
9+
- Gate: WikiNews-2024 multiref <= 5.0 (stretch <= 3.0); ID reported
10+
as-is (specialist doctrine — two families, never averaged).
11+
- Ship: ara-diac-news-1.0 via export_imf_hf (one command).

‎TODO.sota/26-heb-noisy-student.md‎

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
# WO26 — Hebrew noisy student (defend and extend the crown)
2+
3+
8.18 is text-only SOTA; byt5-large showed capacity is NOT the lever at
4+
50K gold units — DATA is. Stage 1 (RUNNING): plane-2.0 pseudo-labels
5+
40K hewiki windows with per-position margins (NO LLM). Stage 2:
6+
gold v4 (50K) + pseudo (cap 40K, keep_frac >= 0.9) on byt5-base.
7+
8+
- Gate: artifact-level DER < 8.18 else negative.
9+
- Lesson applied: capacity arms are closed; only data moves Hebrew.

0 commit comments

Comments
 (0)