The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
Repository Index
84,583 visible repositories in the index
1–16 of 16 · Most stars
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
- pandas-profiling
- pandas-dataframe
- statistics
- jupyter-notebook
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
- weak-supervision
- data-cleaning
- data-quality
- noisy-labels
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
- ai-pipelines
- approximate-statistics
- statistical-properties
- data-quality
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
- data-lineage
- data-governance
- data-warehouse
- snowflake
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
- dataprep
- data-science
- datapreparation
- dataconnector
Scalable data pre processing and curation toolkit for LLMs
- data-curation
- llm
- data
- data-prep
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
re_data - fix data issues before your users & CEO would discover them 😊
- data-monitoring
- data-analysis
- data-quality
- data-quality-monitoring
Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- data-analytics
- data-cleaning
- data-cleansing
- data-engineering
Data validation toolkit for assessing and monitoring data quality.
- data-validation
- tabular-data
- data-testing
- data-quality
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
Validates tabular CSV data using predefined validations, inspired from its Python homologue "Great Expectations".
- common-lisp
- csv
- data-validation
- great-expectations