Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

Fancy stream processing made operationally mundane

• message-queue
• stream-processing
• streaming-data
• message-bus

Python Stream Processing

• kafka-streams
• kafka
• python
• asyncio

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

• rust
• database
• sql
• streaming

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

Distributed stream processing engine in Rust

• data
• dev-tools
• infrastructure
• kafka

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

• flogo
• iot
• integration
• golang

Ruby and Rails efficient Kafka processing framework

• karafka-framework
• kafka
• kafka-client
• kafka-clients

A lightweight stream processing library for Go

• stream-processing
• pipeline
• etl
• kafka

Python Stream Processing. A Faust fork

• asyncio
• python-streaming
• kafka
• redis