Route LLMs, embeddings, image generation and speech-to-text across the Macs, Linux servers and Windows PCs you already own. One OpenAI-, Ollama- and Anthropic-compatible endpoint, so Claude Code and Codex run on your own machines. Zero config.
python linux load-balancer embeddings nvidia zero-config fleet-management codex multimodal apple-silicon llm local-llm ollama ai-infrastructure self-hosted-ai openai-compatible claude-code inference-router ollama-cluster
-
Updated
Nov 22, 2026 - Python