Skip to content
#

gpu-pinning

Star

Here is 1 public repository matching this topic...

boringresearchjames / llamafleet

Star 1

llama.cpp fleet manager with orchestration routing — cut AI coding tool costs by routing tool-loop turns to local GPU models and frontier APIs (Copilot, OpenRouter). GPU pinning, heterogeneous pools, browser dashboard, OpenAI-compatible API.

self-hosted nvidia gpu-acceleration multi-model inference-server homelab multi-gpu rocm load-balancing llm llama-cpp llm-inference local-ai gguf ai-gateway llama-server llm-orchestration openai-compatible gpu-pinning llamafleet
  • Updated May 18, 2026
  • JavaScript

Improve this page

Add a description, image, and links to the gpu-pinning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpu-pinning topic, visit your repo's landing page and select "manage topics."

Learn more