Skip to content

Commit cd6d02a

Browse files
author
Ronald Tse
committed
docs(verdicts): run-018 plane v2 clears the rung gate - 3.5905, new on-device frontier (size -45%, latency -67%)
1 parent f83bda2 commit cd6d02a

2 files changed

Lines changed: 41 additions & 1 deletion

File tree

‎TODO.sota-2026/04-stoicheia-diffusion-wo.md‎

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# 04 — WO (queued, unscheduled): plane-factorized char-level masked diffusion
22

3-
Status: ENTERED (2026-10-03, owner: "make it work - ultimately the best SOTA") — in build
3+
Status: RUNG GATE CLEARED (2026-10-04) — teacher-tier phase in flight
44

55
## Entry design decision (2026-10-03)
66

@@ -70,3 +70,22 @@ lacunae / re-segments / **accentuates** / punctuates. Beats Ithaca
7070
4. Entry criteria: (a) 01 (run-009) lands and re-ranks the teacher
7171
frontier; (b) owner authorizes a new architecture line; (c) a
7272
decode-parity design exists for non-AR models (IMF v2 question).
73+
74+
75+
## Results (measured)
76+
77+
**run-017 (v1, 350k units, 1 epoch, K=4):** full-set Total DER
78+
4.7615 / Morph 3.0530 — 0.19pp off the 4.5701 rung. Grid (subset,
79+
labeled): quality monotonically improving 3.295→2.991→2.934 across
80+
checkpoints (UNDERtrained, not overfit); K flat 2/4/8.
81+
82+
**run-018 (v2, 551k units uncapped, 2 epochs, K=2):** full-set
83+
**Total DER 3.5905 / Morph 2.2149** — the 4.5701 rung gate CLEARED by
84+
0.98pp (21% relative error reduction). ONNX int8 artifact: 219 MB
85+
(-45% vs the shipped 491 MB seq2seq int8static) and 1,145 ms/window
86+
on the same machine where the shipped artifact takes 3,459 ms (-67%).
87+
**The plane model is the new on-device frontier on all three axes.**
88+
Gap to the teacher tier (2.2864): 1.30pp.
89+
90+
**Teacher-tier phase (run-019):** same recipe on the ByT5-LARGE
91+
encoder — the SOTA-dedicated gate (beat 2.2864) is the target.

‎docs/RESULTS.md‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1025,3 +1025,24 @@ much as the knowledge. Paradigm-table aux is closed (no dose tuning,
10251025
no convention-normalization retry recorded as future work; a lexical
10261026
lever, if ever revisited, must be rendered into benchmark-convention
10271027
running text). The frontier mover on record remains the r7 news mix.
1028+
1029+
## run-018 plane v2 — the 4.5701 rung CLEARED: new on-device frontier on all axes (2026-10-04)
1030+
1031+
The plane-factorized encoder (Stoicheia WO, TODO.sota-2026/04) at its
1032+
second configuration clears the student rung decisively:
1033+
1034+
| model | full-set DER | int8 size | CPU ms/window |
1035+
|---|---|---|---|
1036+
| ara-diac-small-2.1 (shipped) | 4.5701 | 491 MB | 3,459 |
1037+
| **plane v2 (run-018, K=2)** | **3.5905** | **219 MB** | **1,145** |
1038+
| r7 teacher | 2.2864 | — | — |
1039+
1040+
−0.98pp DER (−21% relative), −45% size, −67% latency — all three
1041+
on-device axes at once. v1→v2 came from the grid's evidence: uncapped
1042+
corpus (551,431 units), 2 epochs, K=2 (K flat across 2/4/8; the
1043+
parallel-refinement depth is not where quality lives — bidirectional
1044+
conditioning is). Architecture: ByT5-small encoder + diacritic-plane
1045+
embedding + per-position haraqat classification; Mask-Predict
1046+
self-conditioning; one ONNX graph, host-side K-pass loop, no KV
1047+
cache. Morph DER 2.2149. Teacher-tier phase (ByT5-large encoder,
1048+
run-019) attacks the 2.2864 SOTA-dedicated gate next.

0 commit comments

Comments
 (0)