1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
- pandas-profiling
- pandas-dataframe
- statistics
- jupyter-notebook
142,273 visible repositories in the index
1–24 of 31 · Most stars
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Always know what to expect from your data.
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
A light-weight, flexible, and expressive statistical data testing library
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Data Contracts engine for the modern data stack. https://www.soda.io
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Scalable data pre processing and curation toolkit for LLMs
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Automatically find issues in image datasets and practice data-centric computer vision.
A powerful and modular toolkit for record linkage and duplicate detection in Python
Fast Multimodal Semantic Deduplication & Filtering
Library for exploring and validating machine learning data
TranslatedOntiCards is an enterprise-oriented AI Data Hub that offers one-stop capabilities around business databases: data source connection, metadata understanding, natural language query, cross-source fusion, data quality inspection, query auditing, data asset management, and more
pyspark methods to enhance developer productivity 📣 👯 🎉
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match
Data validation toolkit for assessing and monitoring data quality.
The repository host gives no description.
Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.
Generate the smallest test dataset that provably catches broken data-mapping rules in ETL pipelines.
Field-level assurance for data pipelines: mapping-driven source-to-target validation, fault-injection test scoring and explainable risk-adaptive test prioritization.
Inspect, evaluate, and stress-test an existing semantic layer. Runs fully offline.