Probabilistic data structures for processing continuous, unbounded streams.
- bloom-filter
- go
- stable-bloom-filters
- cuckoo-filter
Repository Index
47,133 repositories indexed
193–216 of 534 · Most stars
Stream Processing and Complex Event Processing Engine
- streaming-data-processing
- cep
- stream-processing
- complex-event-processing
Python Streaming DataFrames for Kafka
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Ncurses based XMPP client
- xmpp-client
- c
- xmpp
- chat
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
- data
- spark
- java
- iceberg
Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
Clean APIs for data cleaning. Python implementation of R package Janitor
- pandas
- dataframe
- data
- cleaning-data
Distributed Stream Processing
- stream-processing
- stream-processor
- stream-processing-engine
- pony-language
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
- rabbitmq
- ruby
- amqp
- amqp0-9-1
visual data prep powered by python
- data
- data-pipelines
- etl
- structured-data
asyncio client for kafka
- asyncio
- kafka
- kafka-client
Import CSV and JSON into PostgreSQL the easy way
A high available,high performance distributed messaging system.
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
RabbitMQ Java client
- rabbitmq
- java
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
tools for working with streams of data
Real-time stream processing for python
- streaming-data
- python
- async
- real-time
Trill is a single-node query processor for temporal or streaming data.
- streaming-data
- temporal-data
Python3 client for NATS
- asyncio
- nats
- python3
- cloud-native