Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Repository Index
47,133 repositories indexed
73–96 of 103 · Most stars
Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.
🇪🇺 Warehouse-native Analytics compatible with Google Analytics and Matomo tracking protocols. Ingest into ClickHouse, BigQuery or CSV/Parquet on S3/GCS/local fs while maintaining complete control over your data.
- clickhouse
- ga4
- tracker
- bigquery
A blazing fast fully-automated CSV to database importer
- csv2sql
- csvs
- database
- csv-files
Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.
Export your database from Lovable Cloud to Supabase
Algorand's data pipeline framework.
Track Go benchmark performance over time by storing results in InfluxDB
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
- dotnet
- dotnet-core
- etl
- etl-framework
A simple data project for Steam data
- steam
- steam-data
- steam-api
- python
Interfaces ham radio APRS-IS servers and saves packet data into an influxdb database
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
- neo4j
- java
- neo4j-graphaware-framework
Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
- postgres
- postgresql
- python
- infectious-disease
Live import all your Google Sheets to your data warehouse
- data-warehouse
- data-vault
- etl
- google-sheets
Internet Archive's Sparkling Data Processing Library
High performant ETL engine written in TypeScript
- data-processing
- etl
- etl-framework
- streaming-data
R COBOL DI (Data Integration) Package : Import COBOL CopyBook data files directly into R as properly structured data frames.
- r
- data-science
- dataframe
- data-frames
Real-time GTFS database loader and ORM library.
WFFM Conversion Tool is a tool to convert Sitecore WFFM forms items and data to Sitecore Forms.
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana
Analyse GTFS Schedule data by importing it into a DuckDB database.
ETL scripts for EOS.
- eos
- eosio
- etl
- apache-beam
Instant data for apps on Bitcoin.
- clarity
- stacks
- typescript
- blockchain