Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
TranslatedLLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. Supports mainstream models such as OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, 字节豆包 (Doubao, "bean bun", from ByteDance), ChatGLM, 文心一言 (Wenxin Yiyan, "literary heart, one utterance"), 讯飞星火 (Xunfei Xinghuo, "iFlytek Spark"), 通义千问 (Tongyi Qianwen, "Tongyi thousand questions"), 360 智脑 (360 Zhinao, "360 smart brain") and 腾讯混元 (Tencent Hunyuan, "primordial chaos"), with unified API adaptation, usable for key management and secondary distribution. One-click deployment, ready to use out of the box.
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
- ai
- cognitive-architecture
- vector-database
- ai-agents
Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
OpenUI let's you describe UI using your imagination, then see it rendered live.
- ai
- generative-ai
- html-css-javascript
- tailwindcss
The Cloud Native AI Platform
- ml
- kubernetes
- minikube
- tensorflow
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
IoT Platform Framework
- golang
- iot-platform
- edge-computing
- distributed-systems
OpenTelemetry-native tracing, token tracking, cost attribution, and prompt analytics for Go backends integrating LLMs.