1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
- pandas-profiling
- pandas-dataframe
- statistics
- jupyter-notebook
132,241 visible repositories in the index
1–17 of 17 · Most stars
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
A light-weight, flexible, and expressive statistical data testing library
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
Data Contracts engine for the modern data stack. https://www.soda.io
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
re_data - fix data issues before your users & CEO would discover them 😊
AI based entity resolution, identity resolution, master data management and deduplication at scale for humans and agents
Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). MIT.
Data quality assessment and metadata reporting for data frames and database tables
The repository host gives no description.
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
Declarative data quality engine. Define checks in YAML, run anywhere.
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
Open, audit-grade agentic data quality framework with portable industry packs