🦍 The API and AI Gateway
- api-gateway
- microservices
- api-management
- serverless
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
- go
- api
- api-management
- api-gateway
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.