Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
142,273 visible repositories in the index
1–24 of 45 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Apache Hadoop
Apache Beam is a unified programming model for Batch and Streaming data processing.
Enterprise job scheduling middleware with distributed computing ability.
Apache Ignite
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
🔨 🍇 💻 🚀 GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
The official repository for ROOT: analyzing, storing and visualizing big data, scientifically
Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.
A Scala API for Apache Beam and Google Cloud Dataflow.
Run MapReduce jobs on Hadoop or Amazon Web Services
A cluster computing framework for processing large-scale geospatial data
YTsaurus is a scalable and fault-tolerant open-source big data platform.
Apache Hadoop docker image
A new arguably faster implementation of Apache Spark from scratch in Rust
Apache DataFusion Ballista Distributed Query Engine
Apache Spark docker image
Feathr – A scalable, unified data and AI engineering platform for enterprise
腾讯高性能分布式图计算框架Plato
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
a Map/Reduce framework for distributed computing