Repository Index

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics

The leader in Customer Data Infrastructure

• snowplow
• analytics
• data
• data-pipeline

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

• spark
• pyspark
• azure
• scala

In-memory dimensional time series database.

Distributed Prometheus time series database

• scala
• time-series
• database
• distributed

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• apache-spark
• big-data
• connected-components
• dataframe

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

• spark
• big-data
• bioinformatics
• genomics

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

• snappydata
• spark
• memory-database
• analytics

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

Big Data Science Swiss Army Knife - http://www.tuktu.io --

GNU Scientific Library (GSL) bindings for Scala native

• scala
• scala-native
• gsl
• bindings