Skip to content

docs(TODO.impl): closeouts - lite2 negative, soup negative, framing pre-registered - #96

Merged
ronaldtse merged 1 commit into
mainfrom
docs/impl-ledger-closeouts
Sep 12, 2026
Merged

ronaldtse merged 1 commit into
mainfrom
docs/impl-ledger-closeouts

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

Closes out every axis that resolved today, each with its measured number in the file:

  • 04 (lite-2.0): NEGATIVE — 7.1402 vs run-009's 5.78. Same recipe, same canonical labels, same teacher; the single variable (layer-drop init from the trained 2.1 instead of generic byt5-small) made the student 1.36pp worse. Generic pretraining keeps layers redundant; task adaptation co-specializes them. The depth axis reads 2-of-3 negative; the lite tier is unchanged.
  • 02 (teacher selection): soup postscript — NEGATIVE, 2.4188. The r6+r7 50/50 average is a functional model (same-basin confirmed) but strictly between its parents on every domain; r7 remains the supervision choice.
  • 01 (speculative): closed with the framing finding; the tier is pulled from the playground and the runtime keeps measurement infrastructure (see 11).
  • 11: pre-registered — static activation scales as the structural framing fix, gates defined before measurement. Python-ORT measurement in: framing equal (480/480) for fp32, dynamic AND static int8 — the runtime-measured instability is onnxruntime-node-specific; static scales are the portable fix candidate (also +8% faster than dynamic on CPU).
  • README statuses synced; memo updated with the speculative closeout.

…re-registered

04 closed negative (7.14 vs 5.78, init-source axis closed; depth
reads 2-of-3 negative). 02 gains the soup postscript (2.4188,
same-basin, no gain). 11 pre-registered: static activation scales as
the framing fix, gates defined before measurement. README statuses
synced.
@ronaldtse
ronaldtse merged commit d7975ff into main Sep 12, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant