Adaptive inference scheduling for AI agents — per-round model, effort and provider routing for coding harnesses: a Command Code mod or a local OpenAI-compatible proxy.
-
Updated
Sep 29, 2026 - TypeScript
#
inference-scheduling
Here are 2 public repositories matching this topic...
Reinforcement learning for LLM inference scheduling. DQN agent learns to balance throughput, TTFT, latency, and memory pressure vs FIFO/SJF/priority baselines.
reinforcement-learning pytorch dqn ppo kv-cache ml-systems gpu-scheduling llm-inference ai-infrastructure vectorized-environments inference-scheduling systems-rl
-
Updated
Jul 10, 2026 - Python
Add this topic to your repo
To associate your repository with the inference-scheduling topic, visit your repo's landing page and select "manage topics."