Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
99,825 visible repositories in the index
1–24 of 59 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Spark - A unified analytics engine for large-scale data processing
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
The Reactive Extensions for .NET
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Reactive Extensions for the Go language.
Canonical actor model implementation for .NET with local + distributed actors in C# and F#.
Ultra-high performance reactive programming
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.
Kubernetes-native platform to run massively parallel data/streaming jobs
High-performance time-series aggregation for PostgreSQL
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Compositional, streaming I/O library for Scala
Open source framework for processing, monitoring, and alerting on time series data
YTsaurus is a scalable and fault-tolerant open-source big data platform.
Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
A lightweight stream processing library for Go
Python Stream Processing. A Faust fork
基于flink的实时流计算web平台
Lightweight data stream processing engine for IoT edge