Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Repository Index
47,133 repositories indexed
1–20 of 20 · Most stars
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
- dataquality
- spark
- unit-testing
- scala
Database Subsetting and Relational Data Browsing Tool.
zerocode-tdd is a community-developed, free, open-source, outcome-driven automated testing framework for Data Pipelines, ETL, REST API, Kafka(Data Streams), Databases and Load scenarios. all defined in simple JSON or YAML — with zero coding.
- soap
- assertions
- java
- api
PySpark test helper methods with beautiful error messages
Task management system based on .NET 8 with Microservices, DDD, CQRS, Event Sourcing and Testing Concepts
A curated list of awesome system integration software and resources.
- esb
- bpm
- ipaas
- apimanagement
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
Lightweight and Extensible Infrastructure for Building Web Applications - Web Application Framework
- dotnet-core
- efcore
- aspnet-core
- solid
RabbitMQ wire tap and swiss army knife
- rabbitmq
- tap
- wiretap
- golang
k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond
BENERATOR is a leading software solution to generate, obfuscate, pseudonymize and migrate data for development, testing, and training purposes with a model-driven approach.
- testdata
- anonymization
- migration
- performance-testing
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
- clickhouse
- data-engineering
- data-generation
- devops
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
A JMeter plug-in that enables you to send test results to a Kafka server
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
Declarative data quality engine. Define checks in YAML, run anywhere.
- airflow
- anomaly-detection
- data-contracts
- data-quality
Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets
Gatling plugin for AMQP/RabbitMQ — publish, request-reply, and consume patterns with connection pooling
- amqp
- gatling
- gatling-plugin
- performance