Self-hosted AI gateway for distributed local LLM GPUs. OpenAI-compatible API with NAT traversal, WebSocket/QUIC tunnels, Ollama/vLLM/SGLang workers.
-
Updated
May 12, 2026 - Go
Self-hosted AI gateway for distributed local LLM GPUs. OpenAI-compatible API with NAT traversal, WebSocket/QUIC tunnels, Ollama/vLLM/SGLang workers.
Add a description, image, and links to the deepeseek topic page so that developers can more easily learn about it.
To associate your repository with the deepeseek topic, visit your repo's landing page and select "manage topics."