Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
47,133 repositories indexed
1–4 of 4 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Beam is a unified programming model for Batch and Streaming data processing.
Probabilistic data structures for processing continuous, unbounded streams.
Build platforms that flexibly mix SQL, batch, and stream processing paradigms