SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
- ascend
- audio
- audio-generation
- diffusers
Repository Index
83,087 visible repositories in the index
1–1 of 1 · Most stars