llm-task-scheduling

Here is 1 public repository matching this topic...

AstraNetLab / CacheRoute

CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.

network routing knowledge-injection llm vllm llm-inference kvcache lmcache llm-task-scheduling kvcache-reuse

Updated Aug 10, 2026
Python

Add this topic to your repo

To associate your repository with the llm-task-scheduling topic, visit your repo's landing page and select "manage topics."

Learn more