Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
132,241 visible repositories in the index
1–14 of 14 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
A system for agentic LLM-powered data processing and ETL
A Dockerized python Script to fetch Garmin health data and populate that in a InfluxDB Database, for visualization long term health trends with Grafana
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Python Fast Dataflow programming framework for Data pipeline work( Web Crawler,Machine Learning,Quantitative Trading.etc)
Input pipeline framework
High performance Kafka consumer for InfluxDB. Supports collectd message formats.
Interfaces ham radio APRS-IS servers and saves packet data into an influxdb database
ETL scripts for EOS.
A library and supporting script for pulling data from vSphere and inserting it into InfluxDB