47,133 repositories indexed
49–72 of 72 · Most stars
This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.
Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.
Code to download, process, and analyse the Online Encyclopedia of Integer Sequences
A Substrate indexing framework
Export your database from Lovable Cloud to Supabase
Algorand's data pipeline framework.
Track Go benchmark performance over time by storing results in InfluxDB
Reverse ETL for the code-first data stack
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
Open source industrial IoT connectivity gateway.
Collecting, shape-enhancing, validating, fixing and (partially) merging GTFS feeds
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
High performant ETL engine written in TypeScript
R COBOL DI (Data Integration) Package : Import COBOL CopyBook data files directly into R as properly structured data frames.
Real-time GTFS database loader and ORM library.
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana
Instant data for apps on Bitcoin.
GTFS Data Pipeline for TfNSW Bus Datasets
Peercoin blockchain parser
Data ingestion engine — Singer taps to Parquet in cloud buckets
The repository host gives no description.
Reads EVE files into SQL as well as search stored data.