The data transformation tool the open-source community deserves.
- data-engineering
- duckdb
- data-lineage
- data-pipeline
98,836 visible repositories in the index
49–64 of 64 · Most stars
The data transformation tool the open-source community deserves.
📜 A CLI toolkit for extracting and working with your digital history
go-etl is a toolset for data extraction, transformation and loading.
Event-driven OneLake pipeline with automated Upsert merge and Python reporting
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Flume NG MongoDB source.
Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
Open source industrial IoT connectivity gateway.
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana
Map of #ferguson walk out actions planned for Dec 1, 2014
Instant data for apps on Bitcoin.
Jmeter JTL parsing with Logstash for Elasticseacrh and Influxdb ...
Sitecore Content Hub Asset Importer. Allows importing image assets from various data sources into Sitecore Content Hub.