An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
- ai-pipelines
- approximate-statistics
- statistical-properties
- data-quality
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Scalable data pre processing and curation toolkit for LLMs
- data-curation
- llm
- data
- data-prep
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
Local-first dataset workbench for visual QA, human-approved releases, and traceable metrics.
- data-catalog
- data-governance
- data-lineage
- fastapi
Generate the smallest test dataset that provably catches broken data-mapping rules in ETL pipelines.
Field-level assurance for data pipelines: mapping-driven source-to-target validation, fault-injection test scoring and explainable risk-adaptive test prioritization.