Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

• arrow
• big-data
• pyspark
• rust

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

Stream Processing and Complex Event Processing Engine

• streaming-data-processing
• cep
• stream-processing
• complex-event-processing

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

• flow
• rust
• rust-lang
• stream

A framework for machine-learning bots

Stream Processing Made Easy

• machine-learning
• reactive-programming
• kafka
• reactive-systems