Privacy and Security focused Segment-alternative, in Golang and React
- privacy
- warehouse-management
- data-warehouse
- customer-data
142,273 visible repositories in the index
1–12 of 12 · Most stars
Privacy and Security focused Segment-alternative, in Golang and React
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.
Scratch is a swiss army knife for big data.
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
The data platform for manufacturing
go-etl is a toolset for data extraction, transformation and loading.
Track Go benchmark performance over time by storing results in InfluxDB