Repository Index

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

• cdc
• tidb
• mysql
• kafka

Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

• csv-import
• data-import
• data-mapping
• data-review

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

• kafka-influxdb
• kafka-consumer
• logstash
• influxdb

Universal BLE Smart Scale bridge. Captures body composition from Renpho, Xiaomi & 20+ others, syncs to Garmin Connect, Strava, MQTT (Home Assistant), InfluxDB, Webhooks, Ntfy & local files (CSV/JSONL). Headless CLI for Raspberry Pi, Linux, macOS & Windows.

• garmin
• typescript
• mqtt
• ble

AtlasMap project repository

• atlasmap

Blockchain Indexing Engine

• polkadot
• substrate
• postgres
• indexing

go-etl is a toolset for data extraction, transformation and loading.

• etl
• mysql
• go
• postgresql

Analyse GTFS Schedule data by importing it into a PostgreSQL database.

• gtfs
• postgresql
• postgres
• sql

Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.

This is a library that provides generic functionalities for the implementation of imports. In addition to maximum performance and optimized memory consumption, Pacemaker can also be used to implement imports in distributed scenarios that place the highest demands on speed and stability.

• magento
• import
• products
• categories

Bash script to export android content providers data to csv

• android
• adb
• csv
• content-provider

Doc manager for Neo4j

• mongodb
• mongodb-support
• neo4j
• importer

Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.

• magento2
• magento
• magerun2
• import

A blazing fast fully-automated CSV to database importer

• csv2sql
• csvs
• database
• csv-files

Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.

• gis
• postgis
• geoserver
• golang

Export your database from Lovable Cloud to Supabase

Massively parallel RDBMS to Neo4j Importer

An import river similar to the elasticsearch mysql river

Reverse ETL for the code-first data stack

• bigquery
• cli
• data-engineering
• dbt

Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.

• neo4j
• java
• neo4j-graphaware-framework

Import to Pocketbase

Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.

• postgres
• postgresql
• python
• infectious-disease

Live import all your Google Sheets to your data warehouse

• data-warehouse
• data-vault
• etl
• google-sheets