LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
111,828 visible repositories in the index
1–24 of 25 · Most stars
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
- bert
- sentence-encoding
- deep-learning
- clip-model
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Containers for machine learning
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
- version-control
- experiment-manager
- version
- control
A flexible, high-performance serving system for machine learning models
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
- knative
- machine-learning
- model-interpretability
- model-serving
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, websockets, optional readalong web UI
A blazing fast inference solution for text embeddings models
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
Open-source inference server and production cluster for all the models your agent needs.
Deep Learning Server and CLI for Torch and TensorRT
Turn any computer or edge device into a command center for your computer vision projects.
- computer-vision
- inference-api
- inference-server
- vit
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
- mlops
- python
- data-science
- machine-learning
Machine Learning Platform and Recommendation Engine built on Kubernetes
Boosting your Web Services of Deep Learning Applications.
- deep-learning
- web
- pytorch
- model-deployment
The simplest way to serve AI/ML models in production
- machine-learning
- artificial-intelligence
- easy-to-use
- inference-api
:smiley_cat: Pretty & simple image classifier app template. Deploy your own trained model or pre-trained model (VGG, ResNet, Densenet) to a web app using Flask in 10 minutes.
Bring portraits to life in Real Time!onnx/tensorrt support!实时肖像驱动!
Batched NVIDIA MotionBricks: generate the motion of hundreds of characters in one model call.
- character-animation
- crowd-simulation
- motion-generation
- motionbricks
Detect the sentiment captured in short pieces of text
- docker-image
- machine-learning
- machine-learning-models
- ibm