LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository Index
111,085 visible repositories in the index
1–3 of 3 · Most stars
g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
- managed-by-terraform
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
- ai-gateway
- ai-gateways
- anthropic-api
- byok