Sign in

Repository Index

100,822 visible repositories in the index

Tags: ETL
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–15 of 15 · Most stars

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。

  • mongo-database
  • mongodb-oplog
  • replication
  • active-active

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

  • analytics
  • bigquery
  • data-modeling
  • data-pipelines

go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

  • transform
  • etl
  • xml
  • json

A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.