Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
47,133 repositories indexed
1–3 of 3 · Most stars
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
The Scala API for Quantities, Units of Measure and Dimensional Analysis
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.