Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
Repository Index
47,133 repositories indexed
25–38 of 38 · Most stars
🌱 The ultimate solution for populating your MongoDB database.
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
- java
- smooks
- enterprise-integration
- etl
A data migration and visualization command line gem in Ruby
Universal BLE Smart Scale bridge. Captures body composition from Renpho, Xiaomi & 20+ others, syncs to Garmin Connect, Strava, MQTT (Home Assistant), InfluxDB, Webhooks, Ntfy & local files (CSV/JSONL). Headless CLI for Raspberry Pi, Linux, macOS & Windows.
Code to download, process, and analyse the Online Encyclopedia of Integer Sequences
Algorand's data pipeline framework.
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
- dotnet
- dotnet-core
- etl
- etl-framework
Just swoof it in
- golang
- mysql
Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
- postgres
- postgresql
- python
- infectious-disease
Internet Archive's Sparkling Data Processing Library
GTFS Data Pipeline for TfNSW Bus Datasets
- gtfs
- gtfs-static
- gtfs-realtime
- tfnsw
A library and supporting script for pulling data from vSphere and inserting it into InfluxDB