Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface
Repository Index
55,640 visible repositories in the index
1–4 of 4 · Most stars
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Automatic CPU speed & power optimizer for Linux
- cpu
- speed
- power
- frequency
A native Windows tray app for laptop power, battery runtime and background CPU activity. CPU RAPL, GPU NVML, battery WMI. AC total is a labelled CPU+GPU dual-load sum.