The absolute trainer to light up AI agents.
Repository Index
65,764 visible repositories in the index
1–5 of 5 · Most stars
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Our lightning-fast inference engine.
A minimalistic codebase for training NLG models from HuggingFace Transformers using PyTorch Lightning.
- bart
- generation
- gpt-2
- language-model