Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
132,241 visible repositories in the index
1–6 of 6 · Most stars
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
A fast data collector in Rust
DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS
AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Amazon Redshift Database Loader implemented in AWS Lambda
Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.