Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

• rust
• database
• sql
• streaming

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

• cloud-native
• streaming
• rust
• real-time

StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

• security
• kinesis
• serverless
• terraform

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

Tenzir is the data pipeline engine for security teams.

• incident-response
• threathunting
• siem
• soc

Compositional pipelines

Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.