The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
142,273 visible repositories in the index
1–13 of 13 · Most stars
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Scalable data pre processing and curation toolkit for LLMs
qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.
pyspark methods to enhance developer productivity 📣 👯 🎉
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.
Generate the smallest test dataset that provably catches broken data-mapping rules in ETL pipelines.
Field-level assurance for data pipelines: mapping-driven source-to-target validation, fault-injection test scoring and explainable risk-adaptive test prioritization.
Open, audit-grade agentic data quality framework with portable industry packs