DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
132,241 visible repositories in the index
1–5 of 5 · Most stars
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Halo is an open-source framework built by White Circle for training large language and multimodal models
- agent
- async-rl
- distributed-training
- fine-tuning
A GPipe implementation in PyTorch
- deep-learning
- pytorch
- gpipe
- model-parallelism
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
- multimodal-large-language-models
- deepspeed
- model-parallel
- pipeline-parallelism