LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
111,820 visible repositories in the index
1–14 of 14 · Most stars
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
- model-serving
- mlops
- llmops
- generative-ai
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
Open-source inference server and production cluster for all the models your agent needs.
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
- mlops
- python
- data-science
- machine-learning
The backend agents build with - Multimodal database, orchestration, and serving in one file
Execute Python code on the fly and display results in Tableau visualizations:
- tabpy
- tableau
- tabpy-tutorial
- startup
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
- decision-models
- jev
- laya
- local-inference
The simplest way to serve AI/ML models in production
- machine-learning
- artificial-intelligence
- easy-to-use
- inference-api
Batched NVIDIA MotionBricks: generate the motion of hundreds of characters in one model call.
- character-animation
- crowd-simulation
- motion-generation
- motionbricks
Detect the sentiment captured in short pieces of text
- docker-image
- machine-learning
- machine-learning-models
- ibm