A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- gateway
- generative-ai
- llmops
- llms
47,133 repositories indexed
49–72 of 168 · Most stars
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
An open-source, tool-augmented conversational language model from Fudan University
Retrieval and Retrieval-augmented LLMs
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
Integrating ChatGPT into your browser deeply, everything you need is here
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
🚀 An awesome list of curated Nano Banana pro prompts and examples. Your go-to resource for mastering prompt engineering and exploring the creative potential of the Nano banana pro(Nano banana 2) AI image model.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing tools, and more to accelerate your development.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
Next Generation Agentic Proxy for AI Agents and MCP servers
Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.
Your Friendly Open-Source Gen-AI Platform
The Ruby AI framework.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
TranslatedFull-text PDF translation with layout preserved and bilingual side-by-side display · Search 240 million papers and add them to your library in one click · Q&A over your library knowledge base · AI close reading of papers, literature reviews, and mind maps · Journal quartile / Chinese Academy of Sciences (CAS) ranking / JCR / impact factor shown directly in the list · Plugin-free web version app.ai4paper.pro · Compatible with Zotero 7–10
ChatGPT Neovim Plugin: Effortless Natural Language Generation with OpenAI's ChatGPT API
✨ Reverse-engineered Python API for Google Gemini web app
Artificial Intelligence Infrastructure-as-Code Generator.
OpenDeepWiki is the open-source version of the DeepWiki project, aiming to provide a powerful knowledge management and collaboration platform. The project is mainly developed using C# and TypeScript, supporting modular design, and is easy to expand and customize.
An unofficial Visual Studio Code - OpenAI ChatGPT integration
OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database). Upload your own custom knowledge base files (PDF, txt, epub, etc) using a simple React frontend.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.