Repository Index

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

• llm
• lora
• sft
• multimodal

A Next-Generation Training Engine Built for Ultra-Large MoE Models

• llm
• agent
• deepseek-v3
• gpt-oss

EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

• ai
• gpt
• llm
• nlp

The central nervous system and backend orchestrator for Fractal. It handles multi-tenant task scheduling, real-time TFLOPs budgeting, and federated weight aggregation using FedAvg.

• backend
• fedavg
• federated-learning
• flask

Massively Parallel Deep Reinforcement Learning. 🔥

• pytorch
• reinforcement-learning
• ppo
• sac