1.NVIDIA / Megatron-LMOngoing research training transformer models at scalelarge-language-modelsmodel-paratransformersPythonOther license18K total4.7K forks+267 starsfrom 18,060 · score 5.59
2.microsoft / CNTKArchivedMicrosoft Cognitive Toolkit (CNTK), an open source deep-learning toolkitcognitive-toolkitcntkdeep-learningmachine-learningdeep-neural-networksneural-network+5 moreC++Other license18K total4.2K forks+3 starsfrom 17,580 · score 1.39
3.horovod / horovodArchivedDistributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.tensorflowubermachine-learningmachinelearningmpibaidu+7 morePythonOther license15K total2.2K forks+3 starsfrom 14,672 · score 1.39
4.facebookresearch / PyTorch-BigGraphArchivedGenerate embeddings from large-scale graph-structured data.PythonOther license3.5K total453 forks+2 starsfrom 3,452 · score 1.10
5.tqchen / xgboosthttps://github.com/dmlc/xgboostC++Other license583 total255 forks+1 starsfrom 582 · score 0.69