Repository Index

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

• aws
• gcp
• azure
• sql

Sync MySQL data into elasticsearch

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

• bigquery
• copy-database
• data-ingestion
• data-integration

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

• etl
• sql
• bigquery
• cloud-native

sq data wrangler

• sql
• golang
• go
• excel

Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件

• mysqlbinlog
• mysql-redis
• mysql-mongodb
• go

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

• analytics
• bigquery
• data-modeling
• data-pipelines

Import CSV and JSON into PostgreSQL the easy way

Distributed Data Transfer Service for MySQL

• mysql
• data-transfer
• data-migration
• replication

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

• cdc
• tidb
• mysql
• kafka

go-etl is a toolset for data extraction, transformation and loading.

• etl
• mysql
• go
• postgresql

Just swoof it in

• golang
• mysql