Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
132,241 visible repositories in the index
1–24 of 26 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Flink
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Fast web applications through dynamic, partially-stateful dataflow
A modular implementation of timely dataflow in Rust
An implementation of differential dataflow using timely dataflow on Rust.
Kubernetes-native platform to run massively parallel data/streaming jobs
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
Open source framework for processing, monitoring, and alerting on time series data
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
A lightweight stream processing library for Go
Python Stream Processing
基于开源的flink,对其实时sql进行扩展;主要实现了流与维表的join,支持原生flink SQL所有的语法
基于flink的实时流计算web平台
A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Tenzir is the data pipeline engine for security teams.
Low-code tool for automating actions on real time data | Stream processing for the users.
Streaming reactive and dataflow graphs in Python
The database purpose-built for stream processing applications.
A streaming / online query processing / analytics engine based on Apache Storm