Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
- change-data-capture
- kafka-connect
- apache-kafka
- debezium
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
- csv
- data-wrangling
- opendata
- data-engineering
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
A modern high-performance open source message queuing system
An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV
- mqtt
- mqtt-broker
- iot-edge
- nng
Tenzir is the data pipeline engine for security teams.
- incident-response
- threathunting
- siem
- soc
Canonical GTFS Validator project for schedule (static) files.
- gtfs-dataset
- gtfs-validator
- gtfs-zip
- gtfs-feed
A stream processing framework to build stateless applications on Kafka
- kafka-streams
- clojure
- framework
Postgres change events (CDC) in Elixir [WAL]
- cdc
- change-data-capture
- elixir
- postgres
Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.
Distributed Temporal Graph Analytics with Apache Flink
- graph
- property-graph
- distributed-graph-analytics
- apache-flink
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
A blazing fast fully-automated CSV to database importer
- csv2sql
- csvs
- database
- csv-files
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
- spark
- tweets
- twitter-data
- twitter-json
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz