Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
47,133 repositories indexed
1–4 of 4 · Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Python Streaming DataFrames for Kafka