Repository Index

TranslatedAlibaba's MySQL binlog incremental subscription & consumption component

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

• change-data-capture
• kafka-connect
• apache-kafka
• debezium

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

Fancy stream processing made operationally mundane

• message-queue
• stream-processing
• streaming-data
• message-bus

TranslatedAlibaba distributed database synchronization system (solving the problem of data centers located in different regions of China and the US)

Broadcast, Presence, and Postgres Changes via WebSockets

• elixir
• postgres
• postgresql
• realtime

Source-agnostic distributed change data capture system

Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.

• artificial-intelligence
• developers
• machine-learning
• data

A high-performance Postgres replication engine written in Rust. Embed it in your Rust application or run it as a standalone binary.

• logical-replication
• postgres
• replication
• rust

Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件

• mysqlbinlog
• mysql-redis
• mysql-mongodb
• go

MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具，可以满足迁移和同步的需求，进一步实现灾备和多活功能。

• mongo-database
• mongodb-oplog
• replication
• active-active

Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)

An extensible distributed system for reliable nearline data streaming at scale

• distributed-systems
• data-streaming
• scalability
• kafka-mirror-maker

MySQL to PostgreSQL replica system

• python
• postgresql
• mysql
• mysql-replication

Stream database events from PostgreSQL to Kafka

• postgresql
• events
• stream
• kafka