Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
Repository Index
70,234 visible repositories in the index
1–7 of 7 · Most stars
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
- golang
- event-sourcing
- stream-processing
- brokers
A light-weight package for in-app micro batch processing
- batch
- batch-processing
- event-processing
- go
Create a data stream across your information systems to query, augment and transform data according to Elixir matching rules.
A general-purpose data analysis engine radically changing the way batch and stream data is processed