2bit quants, kernels and runtime for consumer devices.
Repository Index
132,241 visible repositories in the index
1–3 of 3 · Most stars
This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.
- iot-device
- sensor
- edge-machine-learning
- resource-constrained-ml
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
- compression
- language-model
- llm
- pruning