Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
96,838 visible repositories in the index
1–24 of 159 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Free and Open Source Enterprise Resource Planning (ERP)
- manufacturing
- erpnext
- python
- healthcare
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- pytorch
- resnet
- pretrained-models
- pretrained-weights
Distributed Task Queue (development branch)
- python
- task-manager
- task-scheduler
- task-runner
TranslatedChinese translation of 《Designing Data-Intensive Application》 (DDIA), 1st edition / 2nd edition
Translatedstock. Get stock data, calculate stock indicators, chip distribution, identify stock patterns, comprehensive stock selection, stock selection strategies, stock verification and backtesting, automatic stock trading, supports PC and mobile devices.
- stock
- stocks
- backtest
- backtesting
A hyperparameter optimization framework
- python
- machine-learning
- parallel
- distributed
Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
- python
- webassembly
- wasm
- emscripten
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
- weak-supervision
- data-cleaning
- data-quality
- noisy-labels
Generates original ARC-AGI-1-style tasks distribution-matched to the public eval set.
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- cloud-computing
- deep-learning
- gpu
- hyperparameter-tuning
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Modin: Scale your Pandas workflows by changing a single line of code
- dataframe
- pandas
- distributed
- datascience
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
- outlier-detection
- anomaly-detection
- outlier-ensembles
- machine-learning
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Official repository for Spyder - The Scientific Python Development Environment
- spyder
- python
- pyqt5
- anaconda
A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMS. Store compute as Wifi
- compute-orchestration
- distributed-systems
- edge-computing
- edge-intelligence
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book