🦍 The API and AI Gateway
- api-gateway
- microservices
- api-management
- serverless
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
The Cloud-Native API Gateway and AI Gateway
- cloud-native
- nginx
- api-management
- luajit
The Cloud Native AI Platform
- ml
- kubernetes
- minikube
- tensorflow
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
Next Generation Agentic Proxy for AI Agents and MCP servers
Manages Unified Access to Generative AI Services built on Envoy Gateway
- ai
- ai-gateway
- api-gateway
- kubernetes
The open-source policy-as-code software that provides analysis for Multi-Cloud and SaaS environments, you can get insight with natural language (powered by OpenAI).
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.