LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Repository Index
132,241 visible repositories in the index
1–4 of 4 · Most stars
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch