Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
89,572 visible repositories in the index
1–24 of 53 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Spark - A unified analytics engine for large-scale data processing
Apache Flink
Building event-driven applications the easy way in Go.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
The Reactive Extensions for .NET
Apache Storm
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
Reactive Extensions for the Go language.
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Ultra-high performance reactive programming
Kubernetes-native platform to run massively parallel data/streaming jobs
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Open source framework for processing, monitoring, and alerting on time series data
Ruby and Rails efficient Kafka processing framework
Python Stream Processing
基于开源的flink,对其实时sql进行扩展;主要实现了流与维表的join,支持原生flink SQL所有的语法
Lightweight data stream processing engine for IoT edge
👜 Tiny and fast reactive/iterable programming library
Python Streaming DataFrames for Kafka