47,133 repositories indexed
1–16 of 16 · Most stars
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Always know what to expect from your data.
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
A light-weight, flexible, and expressive statistical data testing library
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
:bus: Simple and lean service bus implementation for .NET
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Clean APIs for data cleaning. Python implementation of R package Janitor
Cross-platform beanstalkd queue server admin console.
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.
Simple MQTT Client.
GTFS Data Pipeline for TfNSW Bus Datasets
Estimating the number of clusters in a data set via the gap statistic. Implemented in H2O-3