LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
89,572 visible repositories in the index
1–24 of 29 · Most stars
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Production infrastructure for machine learning at scale
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
- version-control
- experiment-manager
- version
- control
Statistical Machine Intelligence & Learning Engine
- machine-learning
- regression
- clustering
- manifold-learning
All-in-One Development Tool based on PaddlePaddle
- classification
- segmentation
- deployment
- ocr
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
- knative
- machine-learning
- model-interpretability
- model-serving
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets, optional readalong web UI
A blazing fast inference solution for text embeddings models
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
- kubernetes
- machine-learning
- deployment
- serving
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
Stable diffusion for real-time music generation
The repository host gives no description.
- docker
- docker-compose
- faster-whisper
- openai-api
Open-source inference server and production cluster for all the models your agent needs.
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
- fastapi
- streamlit
- pydantic
- python
Deep Learning Server and CLI for Torch and TensorRT
Turn any computer or edge device into a command center for your computer vision projects.
- computer-vision
- inference-api
- inference-server
- vit
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
- machine-learning
- python
- gpu
- llms
High Performance Serving Runtime For Interactive Super Intelligence System
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
- mlops
- python
- data-science
- machine-learning
The backend agents build with - Multimodal database, orchestration, and serving in one file