Repository Index

Apache Flink

• scala
• java
• big-data
• flink

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

Fancy stream processing made operationally mundane

• message-queue
• stream-processing
• streaming-data
• message-bus

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

• rust
• database
• sql
• streaming

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

Distributed stream processing engine in Rust

• data
• dev-tools
• infrastructure
• kafka

High-performance time-series aggregation for PostgreSQL

• realtime
• stream-processing
• analytics
• sql

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

• flogo
• iot
• integration
• golang

The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

• clickhouse
• kakfa
• sql
• redpanda

Lightweight data stream processing engine for IoT edge

• edge
• sql
• iot
• edge-analytics

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

• flow
• rust
• rust-lang
• stream

Trill is a single-node query processor for temporal or streaming data.

• streaming-data
• temporal-data

Esper Complex Event Processing, Streaming SQL and Event Series Analysis

• cep
• complex-event-processing
• open-source
• compiler

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

• golang
• event-sourcing
• stream-processing
• brokers

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

• streaming
• database
• iot
• stream-processing

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

• go
• data-integration
• etl
• data-pipeline

The database purpose-built for stream processing applications.

• stream-processing
• real-time
• sql
• interactive

A streaming / online query processing / analytics engine based on Apache Storm

Reactive queryable observable framework.

• reactive
• rx
• qbservable
• observable