Repository Index

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

• change-data-capture
• kafka-connect
• apache-kafka
• debezium

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

• aws
• gcp
• azure
• sql

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

• data
• python
• data-engineering
• data-lake

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

• etl
• sql
• bigquery
• cloud-native

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

TranslatedOntiCards is an enterprise-oriented AI Data Hub that offers one-stop capabilities around business databases: data source connection, metadata understanding, natural language query, cross-source fusion, data quality inspection, query auditing, data asset management, and more

Simple signalling server that can be used to coordinate handshaking with webrtc or other fun stuff.

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

• message-bus
• messaging
• azure-event-hubs
• pub-sub

The data platform for manufacturing

• oee
• iot

Machine is a workflow/pipeline library for processing data

• golang
• golang-library
• golang-package
• workflow

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

Reverse ETL for the code-first data stack

• bigquery
• cli
• data-engineering
• dbt

Collecting, shape-enhancing, validating, fixing and (partially) merging GTFS feeds

💬 Lightweight AlgoChat client for corvid-agent — GitHub Pages hosted

• algochat
• algorand
• blockchain
• encrypted-messaging