The simplest, fastest repository for training/finetuning medium-sized GPTs.
Repository Index
47,133 repositories indexed
1–18 of 18 · Most stars
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
- abliteration
- llm
- transformer
- censorship-resistance
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Toolkit for linearizing PDFs for LLM datasets/training
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Low-code framework for building custom LLMs, neural networks, and other AI models
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
- calibration
- decision-model
- jev
- jev-model
Speedrun for pretraining without backpropagation
Feather agent harness, training integrations, and evaluation tools for knowledge work
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
A minimalistic codebase for training NLG models from HuggingFace Transformers using PyTorch Lightning.
- bart
- generation
- gpt-2
- language-model