The Open Runtime for AI Agents
Repository Index
65,764 visible repositories in the index
145–168 of 663 · Most stars
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
MiniCPM5: SOTA on-device LLMs, small yet powerful.
Low-code framework for building custom LLMs, neural networks, and other AI models
Ekko Studio is a local-first AI workspace for multi-agent chat, coding, and visual workflows, available on desktop and the web.
- ai-agent
- chat-ui
- dashboard
- hermes-agent
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
QLoRA: Efficient Finetuning of Quantized LLMs
The open source codebase powering HuggingChat
- chatgpt
- huggingface
- sveltekit
- hacktoberfest
AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Locally run an Instruction-Tuned Chat-Style LLM
the LLM vulnerability scanner
- ai
- llm-evaluation
- llm-security
- security-scanners
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
- decision-model
- jev
- qwen3
High-speed Large Language Model Serving for Local Deployment
LangChain for Go, the easiest way to write LLM-based programs in Go
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
- academia
- arxiv
- brave
- deep-research
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
- gateway
- llm-gateway
- guardrails
- mcp-gateway