DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
83,586 visible repositories in the index
1–15 of 15 · Most stars
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
- deepspeed-library
- gpt-3
- transformers
- language-model
Model parallel transformers in JAX and Haiku
A unified inference and post-training framework for accelerated video generation.
- diffusers
- diffusion-models
- video-generation
- distillation
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
Scenic: A Jax Library for Computer Vision Research and Beyond
中文nlp解决方案(大模型、数据、模型、训练、推理)
- bert
- nlp
- transformers
- gpt2
PyTorch extensions for high performance and large scale training.
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
- deep-learning
- pytorch
- volunteer-computing
- mixture-of-experts
The first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and push breakthroughs here. Fully peer-to-peer. Join from your browser or CLI.
- agi
- ai-agents
- ai-research
- artificial-general-intelligence