:alarm_clock: AI conference deadline countdowns
Repository Index
72,362 visible repositories in the index
1–2 of 2 · Most stars
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.