The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
- metadata
- datadiscovery
- dataquality
- data-profiling
140,194 visible repositories in the index
1–24 of 32 · Most stars
The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Always know what to expect from your data.
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
A light-weight, flexible, and expressive statistical data testing library
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Data Contracts engine for the modern data stack. https://www.soda.io
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Scalable data pre processing and curation toolkit for LLMs
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
AI based entity resolution, identity resolution, master data management and deduplication at scale for humans and agents
Port(ish) of Great Expectations to dbt test macros
Automatically find issues in image datasets and practice data-centric computer vision.
A powerful and modular toolkit for record linkage and duplicate detection in Python
Data quality assessment and metadata reporting for data frames and database tables
Dataform is a framework for managing SQL based data operations in BigQuery
Fast Multimodal Semantic Deduplication & Filtering
qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.
Library for exploring and validating machine learning data
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.