Repository Index

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

• chatgpt
• language-model
• rlhf
• ai

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

• transformers
• vllm
• large-language-models
• raylib

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

• artificial-intelligence
• attention-mechanisms
• deep-learning
• reinforcement-learning

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

• chatbot
• gpt
• large-language-model
• long-context

TranslatedChinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models

• alpaca
• llama
• llm
• llama-2

TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.

• llama
• chatgpt
• gpt
• llm

OpenClaw-RL: Train any agent simply by talking

• async
• memory-systems
• open-claw
• openclaw-skills

Robust recipes to align language models with human and AI preferences

• llm
• rlhf
• transformers

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

• ai
• chain-of-thought
• collaboration
• dataset-generation

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

• electron
• llama
• llms
• lora

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

• machine-learning
• pytorch
• reinforcement-learning

Align Anything: Training All-modality Model with Feedback

• large-language-models
• multimodal
• rlhf
• chameleon

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

• ai
• huggingface
• llms
• openai

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

• agentic
• rlhf
• rlvr

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

从零构建大模型：从预训练到RLHF的完整实践