Skip to content

Commit b9c55ff

Browse files
author
Ronald Tse
committed
fix(e5): build_mtp takes steps only — beta leaked in via the spec splat
1 parent c8673c3 commit b9c55ff

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

‎src/gpu/modal_distill.py‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -749,7 +749,8 @@ def distill_sequence(spec_id: str, epochs: int = 3) -> dict:
749749
_ensure_src_path()
750750
from gpu.mtp import build_mtp
751751

752-
mtp_head = build_mtp(student, **spec["mtp_aux"])
752+
mtp_cfg = spec["mtp_aux"]
753+
mtp_head = build_mtp(student, steps=int(mtp_cfg.get("steps", 3)))
753754
n = sum(q.numel() for q in mtp_head.parameters()) / 1e6
754755
print(f"[{spec_id}] mtp_aux head: {n:.2f}M params", flush=True)
755756
student.train()

0 commit comments

Comments
 (0)