[ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
machine-learning deep-learning decentralized heterogeneous model-serving large-language-models generative-inference llama2
-
Updated
May 6, 2024 - Python