Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Repository Index
57,138 visible repositories in the index
1–4 of 4 · Most stars
Statistical Machine Intelligence & Learning Engine
- machine-learning
- regression
- clustering
- manifold-learning
A flexible, high-performance serving system for machine learning models
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.