Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–17 of 17 · Most stars
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
- pandas-profiling
- pandas-dataframe
- statistics
- jupyter-notebook
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
- weak-supervision
- data-cleaning
- data-quality
- noisy-labels
Open Source Feature Flags, Experimentation, and Product Analytics
- abtesting
- statistics
- abtest
- experimentation
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
- database
- data-analysis
- data-warehouse
- olap
visual data prep powered by python
- data
- data-pipelines
- etl
- structured-data
This repository is a getting started guide to Singer.
- etl
- etl-framework
- python
- singer
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
oneAPI Data Analytics Library (oneDAL)
- onedal
- data-analysis
- oneapi
- machine-learning
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- data-analytics
- data-cleaning
- data-cleansing
- data-engineering
A curated list of awesome Qlik extensions and resources for Qlik Sense and QlikView
- qlik
- qlik-sense
- qlik-extension
- qlik-sense-extension