Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
47,133 repositories indexed
1–3 of 3 · Most stars
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Declarative data quality engine. Define checks in YAML, run anywhere.
Validates tabular CSV data using predefined validations, inspired from its Python homologue "Great Expectations".