Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Repository Index
103,113 visible repositories in the index
1–11 of 11 · Most stars
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMS. Store compute as Wifi
- compute-orchestration
- distributed-systems
- edge-computing
- edge-intelligence
Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods
- deep-learning
- machine-learning
- nvidia-gpu
- physics
A distributed graph deep learning framework.
- graph
- graph-learning
- network-embedding
- deep-learning
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Ongoing research training transformer language models at scale, including: BERT & GPT-2
High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
- machine-learning
- knowledge-graph
- knowledge-graphs-embeddings
- graph-learning
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️
- huggingface-transformers
- language-vision
- multimodal
- pytorch
The Deep Learning training framework on Spark