A framework for efficient model inference with omni-modality models
- diffusion
- inference
- model-serving
- pytorch
61,772 visible repositories in the index
1–2 of 2 · Most stars
A framework for efficient model inference with omni-modality models
Sophon-Realtime v1.1: open full-duplex voice models that hear your tone and speak with one. Zero-shot voice cloning, one GPU with vLLM-Omni, OpenAI Realtime / GPT-Live compatible. Apache-2.0.