Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
132,241 visible repositories in the index
1–24 of 46 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
CMAK is a tool for managing Apache Kafka clusters
Apache OpenWhisk is an open source serverless cloud platform
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
酷玩 Spark: Spark 源代码解析、Spark 类库等
REST job server for Apache Spark
A Scala API for Apache Beam and Google Cloud Dataflow.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Apache Spark to Apache Cassandra connector
Feathr – A scalable, unified data and AI engineering platform for enterprise
Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
High performance data store solution
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Apache DataFusion Comet Spark Accelerator
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
A Time Series Library for Apache Spark
A library for time series analysis on Apache Spark
KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster
NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs