SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
132,241 visible repositories in the index
1–15 of 15 · Most stars
Official inference repo for FLUX.1 models
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
- diffusion
- dit
- pytorch
- sana
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
- ai
- cplusplus
- diffusion
- ggml
Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
Lightweight Image Video Action Generation Inference Framework
- video-generation
- wan-video
- diffusion-models
- auto-regressive-diffusion-model
Official inference repo for FLUX.2 models
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
Flux 2 image generation model pure C inference
[ICLR 2025] CatVTON is a simple and efficient virtual try-on diffusion model with 1) Lightweight Network (899.06M parameters totally), 2) Parameter-Efficient Training (49.57M parameters trainable) and 3) Simplified Inference (< 8G VRAM for 1024X768 resolution).
- diffusion-models
- fashion
- try-on
Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows
- ai
- ai-art
- art
- asset-generator
Official inference code for Krea 2
Official inference code for BluePixel, a native 4K image editing model with 4-step distilled inference, built on FLUX.2 Klein and DCAE.
- diffusion-models
- flux
- image-editing
- image-to-image
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
- diffusion-models
- efficient-inference
- high-resolution
- image-generation