1.baidu-baige / LoongSage
A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.
+327 stars
from 228 · score 5.79
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
17 repositories by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
2.NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
+270 stars
from 18,053 · score 5.60
3.modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
+260 stars
from 15,770 · score 5.56
4.microsoft / onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
- deep-learning
- onnx
- neural-networks
- machine-learning
- ai-framework
- hardware-acceleration
- +3 more
+218 stars
from 22,000 · score 5.39
5.axolotl-ai-cloud / axolotl
Go ahead and axolotl questions
+154 stars
from 12,510 · score 5.04
6.deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- deep-learning
- pytorch
- gpu
- machine-learning
- billion-parameters
- data-parallelism
- +7 more
+137 stars
from 43,153 · score 4.93
7.Lightning-AI / pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
+79 stars
from 31,362 · score 4.38
8.Lightning-AI / litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
+62 stars
from 13,682 · score 4.14
9.PaddlePaddle / Paddle
TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)
- paddlepaddle
- deep-learning
- scalability
- machine-learning
- neural-network
- python
- +2 more
+34 stars
from 24,100 · score 3.56
10.hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
- pipeline-parallelism
- model-parallelism
- +6 more
+30 stars
from 41,402 · score 3.43
11.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
- paddlenlp
- pretrained-models
- +13 more
+21 stars
from 12,966 · score 3.09
12.dmlc / dgl
Python package built to ease deep learning on graph, on top of existing DL frameworks.
- deep-learning
- graph-neural-networks
+15 stars
from 14,276 · score 2.77
13.microsoft / SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
+11 stars
from 5,241 · score 2.48
14.microsoft / CNTKArchived
Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
- cognitive-toolkit
- cntk
- deep-learning
- machine-learning
- deep-neural-networks
- neural-network
- +5 more
+3 stars
from 17,580 · score 1.39
15.yahoo / TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
- cluster
- featured
- +2 more
+2 stars
from 3,846 · score 1.10
16.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+1 stars
from 14,672 · score 0.69
17.tensorpack / tensorpack
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
+1 stars
from 6,283 · score 0.69