A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
132,241 visible repositories in the index
1–2 of 2 · Most stars
A Datacenter Scale Distributed Inference Serving Framework
聚合ChatGPT官方版、ChatGPT免费版、文心一言、Poe、chatchat等多平台,支持自定义导入平台