Skip to content

[None][perf] prepare_inputs: avoid O(seq_len) get_tokens(0) marshalling on the host - #16791

Merged
hyukn merged 1 commit into
NVIDIA:mainfrom
hyukn:yukunh/prepare-inputs-gettokens-oL
Jul 27, 2026
Merged

[None][perf] prepare_inputs: avoid O(seq_len) get_tokens(0) marshalling on the host#16791
hyukn merged 1 commit into
NVIDIA:mainfrom
hyukn:yukunh/prepare-inputs-gettokens-oL