1.modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Ranked by Attention Score: stars gained over the last 90 complete days
16 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Go ahead and axolotl questions
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)
Making large AI models cheaper, faster and more accessible
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Python package built to ease deep learning on graph, on top of existing DL frameworks.
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
An open-source framework for machine learning and other computations on decentralized data.
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building Deep Learning (DL) machine learning (ML) models