Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
132,241 visible repositories in the index
1–24 of 56 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Building event-driven applications the easy way in Go.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Fancy stream processing made operationally mundane
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache Storm
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Fast web applications through dynamic, partially-stateful dataflow
Reactive Extensions for the Go language.
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
Ultra-high performance reactive programming
Kubernetes-native platform to run massively parallel data/streaming jobs
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Compositional, streaming I/O library for Scala
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
The Feldera Incremental Computation Engine
A lightweight stream processing library for Go
Python Stream Processing
Python Stream Processing. A Faust fork
基于flink的实时流计算web平台
Lightweight data stream processing engine for IoT edge
👜 Tiny and fast reactive/iterable programming library