Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

CMAK is a tool for managing Apache Kafka clusters

• kafka
• scala
• cluster-management
• big-data

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

• spark
• pyspark
• azure
• scala

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• apache-spark
• big-data
• connected-components
• dataframe

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

• spark
• big-data
• bioinformatics
• genomics

Sparkling Water provides H2O functionality inside Spark cluster

• h2o
• spark
• machine-learning
• integration

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis