1.deepspeedai / DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.deep-learningpytorchgpumachine-learningbillion-parametersdata-parallelism+7 morePythonAPACHE-2.043K total5.1K forks+152 starsfrom 43,129 · score 5.03