Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
47,133 repositories indexed
1–3 of 3 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark