Skip to content

Commit 3fa735e

Browse files
ronaldtseRonald Tse
andauthored
docs: TODO.sota 20-23 — heb-large arm, plane transfer, release queue, ORT alignment (root cause corrected) (#271)
Co-authored-by: Ronald Tse <ronald.tse@gmail.com>
1 parent a5bc857 commit 3fa735e

5 files changed

Lines changed: 46 additions & 1 deletion

File tree

‎TODO.sota/00-README.md‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,11 @@ hf jobs run --flavor a100-large -d \
5656
| 16 | 16-parking-lot.md | — | — | parked (not now) |
5757
| 17 | 17-arabic-register-closure.md | P1 | 11 | r8a RUNNING; r8b launching |
5858
| 18 | 18-parity-runs.md | P1 | 10 | pending |
59-
| 19 | 19-lexicon-loader.md | P2 | 13 | pending |
59+
| 19 | 19-lexicon-loader.md | P2 | 13 | DONE (py#33) |
60+
| 20 | 20-hebrew-large-arm.md | P1 | 04 | RUNNING (run-026, byt5-large/K=4) |
61+
| 21 | 21-arabic-plane-transfer.md | P2 | 17 | pending verdict |
62+
| 22 | 22-runtime-releases.md | P1 | 14 | PREPARED — owner-gated versions |
63+
| 23 | 23-ort-alignment.md | P1 | 18 | golden regen on ORT 1.29 RUNNING; re-dispatch after |
6064

6165
## Schedule
6266

‎TODO.sota/20-hebrew-large-arm.md‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# WO20 — Hebrew byt5-large arm (run-026)
2+
3+
RUNNING (a100-large): byt5-large encoder, 3 epochs (large overfits 50K
4+
units faster), K=4, bs4/accum4. Same gate protocol as WO04.
5+
6+
- Gate: artifact-level DER < 8.18 (beat base) — else negative verdict.
7+
- Ship: export int8, package, 3-leg parity (goldens on linux/ORT-1.29
8+
per WO23), owner-confirmed version.
9+
- Honest risk: 1.2B params on 50K units may overfit by epoch 2; the
10+
per-epoch gate decides.
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# WO21 — Arabic plane register transfer (post-r8)
2+
3+
Once WO17's dual-surface verdict names the winning silver mixture
4+
(r8a self / r8b qcri / r8c both), retrain ara-diac-plane-large with
5+
that mixture (same plane recipe) so the ON-DEVICE family inherits the
6+
register closure — not just the dedicated line. Gate: plane-large OOD
7+
(18.69/11.35) moves AND in-domain stays ≤3.0.

‎TODO.sota/22-runtime-releases.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
# WO22 — runtime release queue (OWNER-GATED, prepared)
2+
3+
Everything staged; version numbers are owner decisions (standing rule):
4+
5+
1. interscript-ts 5.7.0 (plane kind + preserve + parity leg) — unblocks
6+
the api worker's real dependency (vitest alias is dev-only today).
7+
2. interscript-ruby gem next (plane preserve + index-v9 + bound knob).
8+
3. interscript-py (pip) — still blocked on the previous developer's PyPI
9+
trusted-publisher fix; everything staged per TODO.final/01.
10+
4. api-worker deploy: after (1), drop the vitest alias + type
11+
augmentation and deploy with the real package.

‎TODO.sota/23-ort-alignment.md‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# WO23 — ORT generation alignment (the parity root cause, corrected)
2+
3+
WO18 mis-attributed the ruby-vs-py 9.25% skew to "the gem's older ORT".
4+
The gem bundles ORT **1.29.0** — NEWER than the golden-generation
5+
platform (py 1.20.1). The skew is a GOLDEN-PLATFORM version mismatch.
6+
7+
Fix (eval infrastructure only — no library requirement changes):
8+
1. Golden generation pins onnxruntime==1.29.0 (HF cpu job).
9+
2. neural-parity py leg pins the same.
10+
3. Re-dispatch with DEFAULT bounds; if ruby passes, the calibrated
11+
tiers stand and the per-dispatch override reverts to escape-hatch.
12+
4. ts onnxruntime-node bump (1.27→1.29) is a runtime requirement change
13+
— owner decision, only if the ts leg misses tolerance.

0 commit comments

Comments
 (0)