Repository Index

Ongoing research training transformer models at scale

• large-language-models
• model-para
• transformers

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.

• model

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

• transformers
• vllm
• large-language-models
• raylib

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

• deepspeed-library
• gpt-3
• transformers
• language-model

Model parallel transformers in JAX and Haiku

Scenic: A Jax Library for Computer Vision Research and Beyond

• jax
• computer-vision
• deep-learning
• research

中文nlp解决方案(大模型、数据、模型、训练、推理)

• bert
• nlp
• transformers
• gpt2

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.