AirLLM 2.8T LLM inference with single 4GB GPU
- chinese-nlp
- finetune
- generative-ai
- instruct-gpt
132,241 visible repositories in the index
1–5 of 5 · Most stars
AirLLM 2.8T LLM inference with single 4GB GPU
OneDiff: An out-of-the-box acceleration library for diffusion models.
Efficient computing methods developed by Huawei Noah's Ark Lab
Distill your LLM traces into a fast hybrid System 1 models. Open-source ML + LLM inference with calibrated deferral.
This is the github repository for converting craft pretrained model to tflite version