Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
Repository Index
47,133 repositories indexed
1–6 of 6 · Most stars
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline
ETL scripts for EOS.
- eos
- eosio
- etl
- apache-beam