Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件
- mysqlbinlog
- mysql-redis
- mysql-mongodb
- go
111,821 visible repositories in the index
73–96 of 215 · Most stars
Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
LarkMidTable 是一站式开源的数据中台,实现中台的 基础建设,数据治理,数据开发,监控告警,数据服务,数据的可视化,实现高效赋能数据前台并提供数据服务的产品。
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
Apache Spark to Apache Cassandra connector
Markdown 批量导出工具、开放式跨平台博客解决方案,随意组合写作平台(语雀/Notion/FlowUs/飞书/我来Wolai)和博客平台(Hexo/Vitepress/Halo/Confluence/WordPress等)
MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Scalable data pre processing and curation toolkit for LLMs
高性能表格数据导出器
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Data processing & ETL framework for Ruby
The ToroDB solution to provide better analytics on top of MongoDB and make it easier to migrate from MongoDB to SQL
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
Database Reporting Tool and Tasks (.Net)
Extract Transform Load for Python 3.5+
cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Python Streaming DataFrames for Kafka
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 427 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Hop Orchestration Platform