Repository Index

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

• ray
• distributed
• parallel
• machine-learning

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• deep-learning
• pytorch
• gpu
• machine-learning

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)

• paddlepaddle
• deep-learning
• scalability
• machine-learning

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMS. Store compute as Wifi

• compute-orchestration
• distributed-systems
• edge-computing
• edge-intelligence

A unified ecosystem and workspace for large-scale federated learning, bridging the gap between centralized model evolution and decentralized edge intelligence.

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.

• deep-learning
• machine-learning
• ml-platform
• ml-infrastructure

Proof Of Concept of DEcentralised Machine Learning on top of the Golem (https://golem.network/) architecture

• golem
• decentralised-machine-learning
• federated-learning