AirLLM 2.8T LLM inference with single 4GB GPU
- chinese-nlp
- finetune
- generative-ai
- instruct-gpt
132,241 visible repositories in the index
1–8 of 8 · Most stars
AirLLM 2.8T LLM inference with single 4GB GPU
Run Mixtral-8x7B models in Colab or consumer desktops
OneDiff: An out-of-the-box acceleration library for diffusion models.
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆28 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
Efficient computing methods developed by Huawei Noah's Ark Lab
Distill your LLM traces into a fast hybrid System 1 models. Open-source ML + LLM inference with calibrated deferral.
Low-bit LLM inference on CPU/NPU with lookup table
This is the github repository for converting craft pretrained model to tflite version