Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

Incremental engine for long horizon agents 🌟 Star if you like it!

• ai
• change-data-capture
• data-indexing
• etl

Kubernetes-native platform to run massively parallel data/streaming jobs

• kubernetes
• stream-processing
• data-processing
• k8s

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

• streaming
• database
• iot
• stream-processing

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

• data-science
• data-processing
• python
• apache-spark

High performant ETL engine written in TypeScript

• data-processing
• etl
• etl-framework
• streaming-data