LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
55,140 visible repositories in the index
1–9 of 9 · Most stars
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Production infrastructure for machine learning at scale
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
- machine-learning
- scale
- workflow
- mlops
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
All-in-One Development Tool based on PaddlePaddle
- classification
- segmentation
- deployment
- ocr
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
- knative
- machine-learning
- model-interpretability
- model-serving
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
- kubernetes
- machine-learning
- deployment
- serving
Detect the sentiment captured in short pieces of text
- docker-image
- machine-learning
- machine-learning-models
- ibm