perf: share vocab-parallel top-k logits for target and draft - #1534

Open

sufubao wants to merge 3 commits into

ModelTC:mainfrom

sufubao:exact-vocab-parallel-greedy

Commits on Sep 1, 2026

perf: avoid full-vocab all-gather for draft greedy sampling
sufubao
committed
9a61507

Commits on Sep 2, 2026

perf: share vocab-parallel top-k logits
sufubao
committed
ac8a456
style: apply pre-commit formatting
sufubao
committed
f99737d