Skip to content

Commit d39b61a

Browse files
Ronald Tseronaldtse
authored andcommitted
docs: run-019 epoch-2 corrected verdict 2.7397 - SOTA gate stays open, teacher-tier phase closed
1 parent 9bab088 commit d39b61a

2 files changed

Lines changed: 35 additions & 0 deletions

File tree

‎TODO.sota-2026/04-stoicheia-diffusion-wo.md‎

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -89,3 +89,21 @@ Gap to the teacher tier (2.2864): 1.30pp.
8989

9090
**Teacher-tier phase (run-019):** same recipe on the ByT5-LARGE
9191
encoder — the SOTA-dedicated gate (beat 2.2864) is the target.
92+
93+
**run-019 epoch-2 (final, 2026-10-05):** full-set **Total DER 2.7397
94+
/ Morph 1.6717** (epoch-1: 3.0078/1.8486). SOTA-dedicated gate (2.2864)
95+
NOT cleared — +0.45pp — and the per-epoch gain curve (−1.17 small,
96+
−0.27 here) makes a third epoch unfavorable. Podium: r7 2.2864 >
97+
plane-large-e2 2.7397 > plane-large 3.0078 > Gemini-Flash 3.1926.
98+
Teacher-tier phase CLOSED on evidence: the plane architecture's edge is
99+
the on-device frontier (run-018), not the teacher tier. The conditional
100+
run-020 full-corpus labeling pass is likewise closed (its trigger was
101+
"only if epoch-2 falls short" — it did; but its own reading stands:
102+
unique-data volume is the lever, and the frontier model run-018 already
103+
holds the efficient tier).
104+
105+
**WO status: ENTERED, executed, closed.** Deliverables shipped:
106+
haraqat_planes.py (byte-exact split/render), run-017/018/019/020
107+
verdicts, secryst-py PlaneModel runtime (PR merged), ONNX export path.
108+
Open packaging: plane v2/large artifact zips + index entries + HF
109+
publish (after this verdict).

‎docs/RESULTS.md‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1072,3 +1072,20 @@ loses to raw-text diversity at scale (run-018's 551k unique units →
10721072
supervision source. A full-corpus teacher labeling pass (~15-20h GPU)
10731073
is the conditional distill follow-up, only if the epoch-2 arm falls
10741074
short of the 2.2864 gate.
1075+
1076+
## run-019 epoch-2 — 2.7397: second epoch closes a third of the gap, SOTA gate still open (2026-10-05)
1077+
1078+
The epoch-2 extension of plane-large scores full-set **Total DER
1079+
2.7397 / Morph 1.6717 / Total WER 8.6083** — down from 3.0078/1.8486
1080+
at 1 epoch (−0.27pp, −9%). The dedicated podium becomes r7 2.2864,
1081+
plane-large-e2 2.7397, plane-large 3.0078: still ahead of Gemini-Flash
1082+
(3.1926), still behind the teacher (+0.45pp). A third epoch is not
1083+
scheduled — the per-epoch gain (−1.17pp small tier, −0.27pp here) is
1084+
shrinking faster than the 0.45pp gap.
1085+
1086+
Process note: the first epoch-2 eval was invalid — it resumed from the
1087+
epoch-1 eval progress file, found every window already "saved", and
1088+
re-scored epoch-1 predictions (bit-identical 3.0078). Fixed by a
1089+
per-marker progress file (EVAL_DONE_E2B) and re-run in full; the
1090+
number above is the corrected measurement. The 2026-10-04 epoch-1
1091+
verdict was a fresh eval and is unaffected.

0 commit comments

Comments
 (0)