ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Repository Index
81,588 visible repositories in the index
1–1 of 1 · Most stars
81,588 visible repositories in the index
1–1 of 1 · Most stars
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.