Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
108,094 visible repositories in the index
1–19 of 19 · Most stars
Parallel computing with task scheduling
- dask
- python
- pydata
- numpy
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
Data-Centric Pipelines and Data Versioning
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
The official repository for ROOT: analyzing, storing and visualizing big data, scientifically
- data-analysis
- root-cern
- root
- c-plus-plus
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
- spark
- dask
- data-practitioners
- machine-learning
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
Apache Spark docker image
- spark-kubernetes
- kubernetes
- k8s-spark
- docker
Feathr – A scalable, unified data and AI engineering platform for enterprise
- feature-engineering
- feature-store
- artificial-intelligence
- mlops
:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions
- adaptive-learning
- machine-learning
- python
- live-plots
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
- hpc
- workflow
- workflow-automation
- workflow-management
Distributed Temporal Graph Analytics with Apache Flink
- graph
- property-graph
- distributed-graph-analytics
- apache-flink
Serverless ML Framework
Web application for distributed compute analysis of Archive-It web archive collections.