Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
142,273 visible repositories in the index
1–16 of 16 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Fast web applications through dynamic, partially-stateful dataflow
A modular implementation of timely dataflow in Rust
An implementation of differential dataflow using timely dataflow on Rust.
Kubernetes-native platform to run massively parallel data/streaming jobs
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
A lightweight stream processing library for Go
Python Stream Processing
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Tenzir is the data pipeline engine for security teams.
Low-code tool for automating actions on real time data | Stream processing for the users.
Streaming reactive and dataflow graphs in Python
Machine is a workflow/pipeline library for processing data