Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Repository Index
95,842 visible repositories in the index
1–24 of 25 · Most stars
Sync MySQL data into elasticsearch
Source-agnostic distributed change data capture system
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
- artificial-intelligence
- developers
- machine-learning
- data
Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL
- mysql
- python
- mysql-replication-protocol
- mysql-binlog
A high-performance Postgres replication engine written in Rust. Embed it in your Rust application or run it as a standalone binary.
- logical-replication
- postgres
- replication
- rust
Postgres change data capture to streams, queues, and search indexes like Kafka, SQS, Elasticsearch, HTTP endpoints, and more
- cdc
- change-data-capture
- elixir
- erlang
Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件
- mysqlbinlog
- mysql-redis
- mysql-mongodb
- go
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
- mongo-database
- mongodb-oplog
- replication
- active-active
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
The ToroDB solution to provide better analytics on top of MongoDB and make it easier to migrate from MongoDB to SQL
Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
- apis
- data
- rust
- sql
JSON output plugin for changeset extraction
- postgres
- replication
- plugin
- json
Postgres, MySQL, or MariaDB to Elasticsearch/OpenSearch sync
- elasticsearch
- elasticsearch-sync
- postgresql
- change-data-capture
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
- elasticsearch
- go
- golang
- mongodb
Distributed Data Transfer Service for MySQL
- mysql
- data-transfer
- data-migration
- replication
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
MySQL to PostgreSQL replica system
- python
- postgresql
- mysql
- mysql-replication
Automatic data change tracking for PostgreSQL
- audit-log
- audit-trail
- change-data-capture
- change-tracking
Enhanced PostgreSQL logical replication
- postgresql
- logical-replication
- golang
Postgres change events (CDC) in Elixir [WAL]
- cdc
- change-data-capture
- elixir
- postgres
Streaming Postgres logical replication changes atleast-once over websockets
- postgresql
- logical-replication
- write-ahead-log
- websockets
Stream database events from PostgreSQL to Kafka
- postgresql
- events
- stream
- kafka