Repository Index

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

• weak-supervision
• data-cleaning
• data-quality
• noisy-labels

Refine high-quality datasets and visual AI models

• machine-learning
• artificial-intelligence
• deep-learning
• computer-vision

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

• data
• data-cleaning
• data-pipelines
• data-processing

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• spark
• pyspark
• data-wrangling
• bigdata

Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.

• python
• text-processing
• text-parser
• python-module

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

• data-analytics
• data-cleaning
• data-cleansing
• data-engineering

Schema-Inspector is a simple JavaScript object sanitization and validation module.

• javascript
• validation
• sanitization
• data-cleaning