1.baidu-baige / LoongSage
A production-grade, high-efficiency Agentic RL framework for frontier LLMs with validated recipes.
+327 stars
from 228 · score 5.79
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
15 repositories by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
2.NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
+270 stars
from 18,053 · score 5.60
3.modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
+260 stars
from 15,770 · score 5.56
4.axolotl-ai-cloud / axolotl
Go ahead and axolotl questions
+154 stars
from 12,510 · score 5.04
5.deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
- deep-learning
- pytorch
- gpu
- machine-learning
- billion-parameters
- data-parallelism
- +7 more
+137 stars
from 43,153 · score 4.93
6.Lightning-AI / pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
+79 stars
from 31,362 · score 4.38
7.Lightning-AI / litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
+62 stars
from 13,682 · score 4.14
8.hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
- pipeline-parallelism
- model-parallelism
- +6 more
+30 stars
from 41,402 · score 3.43
9.PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
- paddlenlp
- pretrained-models
- +13 more
+21 stars
from 12,966 · score 3.09
10.dmlc / dgl
Python package built to ease deep learning on graph, on top of existing DL frameworks.
- deep-learning
- graph-neural-networks
+15 stars
from 14,276 · score 2.77
11.yahoo / TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
- cluster
- featured
- +2 more
+2 stars
from 3,846 · score 1.10
12.facebookresearch / PyTorch-BigGraphArchived
Generate embeddings from large-scale graph-structured data.
+2 stars
from 3,452 · score 1.10
13.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+1 stars
from 14,672 · score 0.69
14.tensorpack / tensorpack
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
+1 stars
from 6,283 · score 0.69
15.google-parfait / tensorflow-federated
An open-source framework for machine learning and other computations on decentralized data.
+1 stars
from 2,452 · score 0.69