Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
96,838 visible repositories in the index
1–6 of 6 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Scalable and efficient data transformation framework - backwards compatible with dbt.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Python Streaming DataFrames for Kafka
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.