Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
81,337 visible repositories in the index
1–8 of 8 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Mirror of Apache Samoa (Incubating)
A light-weight package for in-app micro batch processing
A general-purpose data analysis engine radically changing the way batch and stream data is processed