Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
109,091 visible repositories in the index
1–21 of 21 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
CMAK is a tool for managing Apache Kafka clusters
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
A Scala API for Apache Beam and Google Cloud Dataflow.
深圳地铁大数据客流分析系统🚇🚄🌟
Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.
GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.
High performance data store solution
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Cassovary is a simple big graph processing library for the JVM
NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs
Sparkling Water provides H2O functionality inside Spark cluster
An open protocol for secure data sharing
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Lightweight real-time big data streaming engine over Apache Pekko
Low-code tool for automating actions on real time data | Stream processing for the users.
Serverless proxy for Spark cluster
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Big Data Science Swiss Army Knife - http://www.tuktu.io --