LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
142,273 visible repositories in the index
1–24 of 32 · Most stars
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
- model-serving
- mlops
- llmops
- generative-ai
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
- version-control
- experiment-manager
- version
- control
Statistical Machine Intelligence & Learning Engine
- machine-learning
- regression
- clustering
- manifold-learning
All-in-One Development Tool based on PaddlePaddle
- classification
- segmentation
- deployment
- ocr
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
- knative
- machine-learning
- model-interpretability
- model-serving
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets, optional readalong web UI
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
- kubernetes
- machine-learning
- deployment
- serving
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
Stable diffusion for real-time music generation
The repository host gives no description.
- docker
- docker-compose
- faster-whisper
- openai-api
Open-source inference server and production cluster for all the models your agent needs.
Deep Learning Server and CLI for Torch and TensorRT
Turn any computer or edge device into a command center for your computer vision projects.
- computer-vision
- inference-api
- inference-server
- vit
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
- machine-learning
- python
- gpu
- llms
High Performance Serving Runtime For Interactive Super Intelligence System
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
- mlops
- python
- data-science
- machine-learning
The backend agents build with - Multimodal database, orchestration, and serving in one file
Execute Python code on the fly and display results in Tableau visualizations:
- tabpy
- tableau
- tabpy-tutorial
- startup