You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix(playground): pull the speculative tier - quantized framing degrades output
Measurement behind the tier (interscript-ml RESULTS.md 2026-09-12):
dynamic-int8 decoder graphs quantize activations per fed tensor, so
single-step and batched decode framings produce materially different
numerics - the batched-verifier output lost a word on a canonical
test row, and runtime acceptance measured 0.46 vs the probe's 0.99
(uniform-framing artifact). int4 CPU kernels are also slower than
int8 here, so the tier had no speed story either. SpeculativeModel
stays in the npm API as measurement infrastructure with the
constraint documented; the playground serves only the verified tiers.
0 commit comments