Skip to content

[TRTLLM-13234][feat] Complete TorchSampler beam search: length_penalty, diversity_rate, early_stopping, VBWS, and CBA performance - #16620

Open
zhaoyangwang-nvidia wants to merge 36 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:beam-length-penalty
Open

[TRTLLM-13234][feat] Complete TorchSampler beam search: length_penalty, diversity_rate, early_stopping, VBWS, and CBA performance#16620
zhaoyangwang-nvidia wants to merge 36 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:beam-length-penalty

[TRTLLM-13234][fix] Hand off a context phase that ends on its only token

5f4906a
Select commit
Loading
Failed to load commit list.