OpenRefine is a free, open source power tool for working with messy data and improving it
- datacleansing
- data-analysis
- java
- opendata
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
- weak-supervision
- data-cleaning
- data-quality
- noisy-labels
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
Refine high-quality datasets and visual AI models
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- web-scraping
- text-extraction
- nlp
- html2text
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
🐋 Docker Cheat Sheet 🐋
- swarm
- docker-swarm
- registry
- volume
A command line tool for cleaning unused resources in Xcode.
- command-line-tool
- resources
- slim
- xcode
Strategies for cleaning databases in Ruby. Can be used to ensure a clean state for testing.
- testing
- ruby
- database-cleaner
- testing-tools
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
- dataprep
- data-science
- datapreparation
- dataconnector
HTMLPurifier for Laravel 5+
- laravel
- php
- htmlpurifier
- cleaning
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Clean APIs for data cleaning. Python implementation of R package Janitor
- pandas
- dataframe
- data
- cleaning-data
Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.
- python
- text-processing
- text-parser
- python-module
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- data-analytics
- data-cleaning
- data-cleansing
- data-engineering
Schema-Inspector is a simple JavaScript object sanitization and validation module.
- javascript
- validation
- sanitization
- data-cleaning
Run Electron without all the junk terminal output
Cute puzzle platformer starring a cleaning robot on post-apocalyptic Earth
Plugin for cleaning up the default key mappings and plugins in Neovim leaving only the bare essentials.
A Sitecore utility module for analyzing and cleaning up your media library