Sign in

Repository Index

90,854 visible repositories in the index

Tags: Machine learning
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–4 of 4 · Most stars

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

  • gptq
  • optimum
  • peft
  • quantization