SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
142,187 visible repositories in the index
1–24 of 25 · Most stars
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Fancy stream processing made operationally mundane
Flink CDC is a streaming data integration tool
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
An open lakehouse engine for agents — Postgres-native, vector-native and Python-native. Speaks PostgreSQL, runs on your object storage, written in Rust.
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL
A high-performance Postgres replication engine written in Rust. Embed it in your Rust application or run it as a standalone binary.
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
JSON output plugin for changeset extraction
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
PostgreSQL replication with DDL changes
DataLink是一个满足各种异构数据源之间的实时增量同步、离线全量同步,分布式、可扩展的数据交换平台。
A tool that can parse, filter, split, and merge RDB files, as well as analyze memory usage offline. It can also sync data between two Redis instances and allows users to define their own sink services to migrate Redis data to custom destinations.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Distributed Data Transfer Service for MySQL
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
MySQL to PostgreSQL replica system
Automatic data change tracking for PostgreSQL
Enhanced PostgreSQL logical replication
Postgres change events (CDC) in Elixir [WAL]
Streaming Postgres logical replication changes atleast-once over websockets
Stream database events from PostgreSQL to Kafka