SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
Repository Index
47,133 repositories indexed
1–21 of 21 · Most stars
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
- csv
- data-wrangling
- opendata
- data-engineering
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
Database Subsetting and Relational Data Browsing Tool.
MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
🌱 The ultimate solution for populating your MongoDB database.
The data transformation tool the open-source community deserves.
A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.
📜 A CLI toolkit for extracting and working with your digital history
- chronicle
- chronicle-etl
- personal-data
- etl
go-etl is a toolset for data extraction, transformation and loading.
RDF-Centric Map/Reduce Framework and Freebase data conversion tool
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
A high performance data transfer tool that can be used to transfer data from Bitcoin Core blockchain files to a SQL Server database
Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
- dotnet
- dotnet-core
- etl
- etl-framework
Real-time GTFS database loader and ORM library.
WFFM Conversion Tool is a tool to convert Sitecore WFFM forms items and data to Sitecore Forms.
A tool to grab AVL data from the database and push it to the ddot-updates service