Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
96,838 visible repositories in the index
1–16 of 16 · Most stars
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
Generates original ARC-AGI-1-style tasks distribution-matched to the public eval set.
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
Democratizing Reinforcement Learning for LLMs
State of the art inference performance with modern accelerators on Kubernetes
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系,成为中文AIGC和认知智能的基础设施。
Machine learning metrics for distributed, scalable PyTorch applications.
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
A crowdsourced distributed cluster for AI art and text generation
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
Evolutionary Algorithm using Python, 莫烦Python 中文AI教学
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fabric.