Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
109,091 visible repositories in the index
1–6 of 6 · Most stars
Apache Spark - A unified analytics engine for large-scale data processing
Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Akka Streams & Akka HTTP for Large-Scale Production Deployments
BlinkDB: Sub-Second Approximate Queries on Very Large Data.
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.