LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
142,273 visible repositories in the index
1–23 of 23 · Most stars
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
- model-serving
- mlops
- llmops
- generative-ai
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets, optional readalong web UI
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- ai
- api
- serving
- artificial-intelligence
The repository host gives no description.
- docker
- docker-compose
- faster-whisper
- openai-api
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
- fastapi
- streamlit
- pydantic
- python
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- llm
- text-embeddings
- bert-embeddings
Deep Learning Server and CLI for Torch and TensorRT
Turn any computer or edge device into a command center for your computer vision projects.
- computer-vision
- inference-api
- inference-server
- vit
High Performance Serving Runtime For Interactive Super Intelligence System
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
- mlops
- python
- data-science
- machine-learning
The backend agents build with - Multimodal database, orchestration, and serving in one file
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
- decision-models
- jev
- laya
- local-inference
Deploy a ML inference service on a budget in less than 10 lines of code.
Boosting your Web Services of Deep Learning Applications.
- deep-learning
- web
- pytorch
- model-deployment
The simplest way to serve AI/ML models in production
- machine-learning
- artificial-intelligence
- easy-to-use
- inference-api
:smiley_cat: Pretty & simple image classifier app template. Deploy your own trained model or pre-trained model (VGG, ResNet, Densenet) to a web app using Flask in 10 minutes.
Chronon is a data platform for serving for AI/ML applications.
CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
Detect the sentiment captured in short pieces of text
- docker-image
- machine-learning
- machine-learning-models
- ibm