The simplest, fastest repository for training/finetuning medium-sized GPTs.
Repository Index
47,133 repositories indexed
1–23 of 23 · Most stars
Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
- abliteration
- llm
- transformer
- censorship-resistance
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Toolkit for linearizing PDFs for LLM datasets/training
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Low-code framework for building custom LLMs, neural networks, and other AI models
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.
A robust Python tool for text-based AI training and generation using GPT-2.
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
- calibration
- decision-model
- jev
- jev-model
🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
Speedrun for pretraining without backpropagation
Scikit-learn for Recursive Self-improvement (RSI). A modular framework for recursive harness evolution.
- meta-learning
- reinforcement-learning
- rsi
- ai-agents
Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.
- artificial-intelligence
- clip
- pathology
- vision-and-language
Feather agent harness, training integrations, and evaluation tools for knowledge work
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
A minimalistic codebase for training NLG models from HuggingFace Transformers using PyTorch Lightning.
- bart
- generation
- gpt-2
- language-model