Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
47,133 repositories indexed
49–72 of 91 · Most stars
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.
Tabix.io UI
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
The Universal Storage Engine
Library for animated data visualizations and data stories.
A Python package for manipulating 2-dimensional tabular data structures
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Powerful Analytics Solution. Setup in 30 seconds. Display all your data on a Simple, AI-powered dashboard. Fully self-hostable and GDPR compliant. Alternative to Google Analytics, MixPanel, Plausible, Umami & Matomo.
The Python ensemble sampling toolkit for affine-invariant MCMC
What's in your data? Extract schema, statistics and entities from datasets
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
visual data prep powered by python
This repository is a getting started guide to Singer.
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
NFStream: a Flexible Network Data Analysis Framework.
Visualize large time series data with plotly.py
TranslatedEvoOntology: A Self-Evolving Ontology Layer for Data Agents ⚙️ The EvoOntology plugin builds and evolves an ontology layer for Claude Code/Codex
Rumale is a machine learning library in Ruby
Practical Data Science with Ruby based tools.
oneAPI Data Analytics Library (oneDAL)
Automate Data Exploration and Treatment
skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.