Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
Repository Index
47,133 repositories indexed
25–48 of 49 · Most stars
Distributed Data Transfer Service for MySQL
- mysql
- data-transfer
- data-migration
- replication
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰
- csv-import
- data-import
- data-mapping
- data-review
Universal BLE Smart Scale bridge. Captures body composition from Renpho, Xiaomi & 20+ others, syncs to Garmin Connect, Strava, MQTT (Home Assistant), InfluxDB, Webhooks, Ntfy & local files (CSV/JSONL). Headless CLI for Raspberry Pi, Linux, macOS & Windows.
📜 A CLI toolkit for extracting and working with your digital history
- chronicle
- chronicle-etl
- personal-data
- etl
go-etl is a toolset for data extraction, transformation and loading.
A plugin to push to Algolia based on graphQl queries
- gatsby
- algolia
- search
- static-site-generator
Analyse GTFS Schedule data by importing it into a PostgreSQL database.
A high performance data transfer tool that can be used to transfer data from Bitcoin Core blockchain files to a SQL Server database
🇪🇺 Warehouse-native Analytics compatible with Google Analytics and Matomo tracking protocols. Ingest into ClickHouse, BigQuery or CSV/Parquet on S3/GCS/local fs while maintaining complete control over your data.
- clickhouse
- ga4
- tracker
- bigquery
A blazing fast fully-automated CSV to database importer
- csv2sql
- csvs
- database
- csv-files
Code to download, process, and analyse the Online Encyclopedia of Integer Sequences
Enables search with Algolia in Hugo static sites
An import river similar to the elasticsearch mysql river
Insert incoming MQTT values into InfluxDB. Follows mqtt-smarthome architecture.
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
Just swoof it in
- golang
- mysql
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
- neo4j
- java
- neo4j-graphaware-framework
Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
- postgres
- postgresql
- python
- infectious-disease
Analyse GTFS Schedule data by importing it into a DuckDB database.
ETL scripts for EOS.
- eos
- eosio
- etl
- apache-beam
Data ingestion engine — Singer taps to Parquet in cloud buckets
Send MQTT messages to Elasticsearch