Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

Python Stream Processing

• kafka-streams
• kafka
• python
• asyncio

🌊 Online machine learning in Python

• incremental-learning
• machine-learning
• python
• online-learning

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

Distributed Stream Processing

• stream-processing
• stream-processor
• stream-processing-engine
• pony-language

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

Stream Processing Made Easy

• machine-learning
• reactive-programming
• kafka
• reactive-systems

Develop streaming applications for IBM Streams in Python, Java & Scala.

• ibm-streams
• java
• scala
• python