LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
132,241 visible repositories in the index
1–12 of 12 · Most stars
OpenSource Production ready Customer service with built in Evals and monitoring
- knowledge-base
- llm
- rag
- customer-service
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
XAI - An eXplainability toolbox for machine learning
Pure Rust Inference Engine
- cuda
- gb10
- llm-inference
- mamba
Design visual, review-gated agent loops for Claude Code before you run them.
- agent-loops
- agentic-workflows
- ai-agents
- claude-code
A ChatGPT, Gemini, Claude, and Ollama(offline) plug-in for Embarcadero RAD Studio IDE XE5 to 12.1
- chatgpt
- chatgpt-api
- delphi
- embarcadero
Aion 2 Prompt Engineering Suite - Config and Dotfiles, Complete With Prompt Engineering
- aion-2
- aion-2-2026
- aion-2-cheat
- aion-2-download
LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
- agent-evaluation
- evaluation-framework
- evaluation-metrics
- java
AION-2-Cheat: Complete Standalone Setup for Aion 2 AI Prompt Engineering
- aion-2
- aion-2-2026
- aion-2-cheats
- aion-2-game
Aion 2 Trainer Tool: Complete Standalone Setup With Advanced AI Prompt Engineering
- aion-2
- aion-2-2026
- aion-2-game
- aion-2-optimizer
AION-2-Cheat: Complete Standalone Setup for Aion 2 AI Prompt Engineering
- aion-2
- aion-2-2026
- aion-2-cheats
- aion-2-game