🧙 Build, run, and manage data pipelines for integrating and transforming data.
Repository Index
95,842 visible repositories in the index
1–9 of 9 · Most stars
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
- machine-learning
- convolutional-networks
- embedding-vectors
- embeddings
Scalable and efficient data transformation framework - backwards compatible with dbt.
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Extract Transform Load for Python 3.5+
- data-processing
- extract-transform-load
- bonobo
- python3
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
The data transformation tool the open-source community deserves.
- data-engineering
- duckdb
- data-lineage
- data-pipeline
Real-time GTFS database loader and ORM library.