1.NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
+2,172 stars
from 16,155 · score 7.68
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
6 repositories by Attention Score · May 9, 2026 – Nov 4, 2026 (UTC)
2.microsoft / CNTKArchived
Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
- cognitive-toolkit
- cntk
- deep-learning
- machine-learning
- deep-neural-networks
- neural-network
- +5 more
+69 stars
from 17,514 · score 4.25
3.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+43 stars
from 14,632 · score 3.78
4.facebookresearch / PyTorch-BigGraphArchived
Generate embeddings from large-scale graph-structured data.
+6 stars
from 3,448 · score 1.95
5.dmlc / minervaArchived
Minerva: a fast and flexible tool for deep learning on multi-GPU. It provides ndarray programming interface, just like Numpy. Python bindings and C++ bindings are both available. The resulting code can be run on CPU or GPU. Multi-GPU support is very easy.
+3 stars
from 709 · score 1.39
+2 stars
from 914 · score 1.10