Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- python
- fine-tuning
- gguf
- huggingface
Repository Index
56,139 visible repositories in the index
1–2 of 2 · Most stars
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.