Skip to content

Commit 15ba4fd

Browse files
authored
Merge pull request #184 from interscript/paper-b-appendix
docs: Paper B appendix — subset-overstatement record
2 parents 24ada60 + c1b0118 commit 15ba4fd

1 file changed

Lines changed: 29 additions & 0 deletions

File tree

‎docs/paper.adoc‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -416,6 +416,35 @@ budget is on the order of 100 A10G-hours.
416416
* Runtimes: `secryst` (Ruby), `secryst` (PyPI), `secryst` (npm) — identical resolution, verification, and decode.
417417
* Every model resolves by id from the public index: `Model.load("tha-g2p-small-1.0")` in any crystal.
418418

419+
== Appendix: the subset-overstatement record
420+
421+
The complete five-instance history behind Section <<section-frontier>>'s
422+
full-set-only rule. "Subset" is the first 300 paragraphs of the
423+
1,200-paragraph SadeedDiac-25 test set; every full-set figure carries
424+
its paired-bootstrap interval in the results log, and every run's
425+
label provenance is a recorded sha256.
426+
427+
[%autowidth,cols="1,4,1,1,1"]
428+
|===
429+
|# |Comparison |Subset |Full set |Date
430+
431+
|1 |1.0 rung vs teacher |3.66 |8.26 |2026-08-26
432+
|2 |scratch d384 (30M) |83.08 (poisoned-label constant; retracted) |74.68 (clean) |2026-08-29
433+
|3 |lite 3ep rung vs teacher |3.81 |7.44 |2026-08-31
434+
|4 |2.1 delta vs teacher |0.72pp |2.28pp (3.2x) |2026-08-31
435+
|5 |lite 6ep depth cost |0.64pp |1.21pp |2026-09-01
436+
|===
437+
438+
Instance 2 is listed for completeness of the ledger's count, not as an
439+
inflation exhibit: its subset figure is the double-encoded-label
440+
constant later retracted (Section <<section-repro>>), and it sits above
441+
the clean-label full-set re-measurement. Instance 4 is the operative
442+
exhibit — the subset was within 0.22pp of claiming a strict
443+
teacher+0.5pp gate closure that the full set refuted by 3.2x,
444+
reversing a residual-attribution conclusion. Mechanism: the first 300
445+
paragraphs sit closer to the students' training domain; the remaining
446+
900 expose the generalization gap the subset hides.
447+
419448
== References
420449

421450
* [%hardbreaks]

0 commit comments

Comments
 (0)