Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
77,852 visible repositories in the index
1–8 of 8 · Most stars
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
- distributed-computing
- map-reduce
- golang
- distributed-systems
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
Distributed Stream Processing
- stream-processing
- stream-processor
- stream-processing-engine
- pony-language
Phoebus is a distributed framework for large scale graph processing written in Erlang.
Distributed batch data processing framework