Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
132,241 visible repositories in the index
1–21 of 21 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Apache Hadoop
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache Ignite
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
A Scala API for Apache Beam and Google Cloud Dataflow.
A cluster computing framework for processing large-scale geospatial data
Apache Hadoop docker image
A new arguably faster implementation of Apache Spark from scratch in Rust
Apache DataFusion Ballista Distributed Query Engine
Apache Spark docker image
Feathr – A scalable, unified data and AI engineering platform for enterprise
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
Apache DataFusion Comet Spark Accelerator
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs
Haskell on Apache Spark.
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
Distributed Temporal Graph Analytics with Apache Flink