Repository Index

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft

Run frontier AI locally.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

• adapter
• diffusion
• llm
• parameter-efficient-learning

TranslatedChinese LLaMA & Alpaca LLMs + local CPU/GPU training and deployment

• llm
• plm
• pre-trained-language-models
• alpaca

Nano vLLM

• inference
• llm
• pytorch
• transformer

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

• llm
• lora
• sft
• multimodal

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

• gpt-2
• adaptation
• language-model
• gpt-3

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

• llms
• lora
• reinforcement-learning
• agent

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

• python
• fine-tuning
• gguf
• huggingface

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

• dpo
• fine-tuning
• inference
• llama

Accessible large language models via k-bit quantization for PyTorch.

• llm
• machine-learning
• pytorch
• qlora

Run LLMs with MLX

• llms
• mlx

TranslatedFirefly: a large model training tool that supports training large models such as Qwen2.5, Qwen2, Yi1.5, Phi-3, Llama3, Gemma, MiniCPM, Yi, Deepseek, Orion, Xverse, Mixtral-8x7B, Zephyr, Mistral, Baichuan2, Llma2, Llama, Qwen, Baichuan, ChatGLM2, InternLM, Ziya2, Vicuna, Bloom, etc.

• gpt
• alpaca
• llm
• baichuan

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

• llava
• llm
• mlx
• vision-transformer

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

• electron
• llama
• llms
• lora

Lord of Large Language and Multi modal Systems Web User Interface

• ai
• llm
• text-generation

🚅 Interactive prompts made simple. Build a prompt like stacking blocks.

• cli
• command-line-tool
• prompts
• customization

🦞 Just talk to your agent — it learns and EVOLVES 🧬.

• agent
• ai-agent
• fine-tuning
• llm

OneTrainer is a one-stop solution for all your Diffusion training needs.

• fine-tuning
• lora
• training
• image-model-training

Dead simple FLUX LoRA training UI with LOW VRAM support

A Unified Library for Parameter-Efficient and Modular Transfer Learning

• nlp
• natural-language-processing
• adapters
• transformers

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

• chatglm
• chatgpt
• freeze
• lora