Skip to content

[TRTLLM-14510][feat] serve: multi-process HTTP frontends on the classic IPC executor path - #16523

Merged
longlee0622 merged 25 commits into
NVIDIA:mainfrom
lancelly:feat/serve-multi-frontend-main
Jul 22, 2026
Merged

[TRTLLM-14510][feat] serve: multi-process HTTP frontends on the classic IPC executor path#16523
longlee0622 merged 25 commits into
NVIDIA:mainfrom
lancelly:feat/serve-multi-frontend-main

[None][test] stop the dispatch thread in the frontend-proxy lifecycle…

f012263
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 21, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO