An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
- deepspeed-library
- gpt-3
- transformers
- language-model
55,140 visible repositories in the index
1–1 of 1 · Most stars
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries