Repository Index

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

• batch-processing
• kafka
• pathway
• python

A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸

• video
• codec
• audio
• learning

A curated list of awesome big data frameworks, ressources and other awesomeness.

• awesome
• bigdata
• data-warehouse
• data-analytics

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.

• webassembly
• data-visualization
• real-time
• analytics

📈 A small, fast chart for time series, lines, areas, ohlc & bars

• time-series
• ohlc
• line-chart
• performance

The Time Series Visualization Tool that you deserve.

• ros
• qt5
• plot
• chart

🌊 Online machine learning in Python

• incremental-learning
• machine-learning
• python
• online-learning

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

• cloud-native
• streaming
• rust
• real-time

React data visualization library for streaming, networks, and AI-assisted development

• nteract
• visualization
• d3
• react

Smoothie Charts: smooooooth JavaScript charts for realtime streaming data

• javascript
• chart
• chart-component
• charting-library

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

• spark
• csharp
• dotnet
• analytics

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...

• benchmarks
• low-latency
• streaming

WebRTC for Jupyter notebook/lab

• jupyter-notebook
• jupyter
• webrtc
• webcam

Real-time decision features without streaming infra. Turn live events into product reflexes — no Kafka, no Flink, no feature store.

• analytics
• feature-store
• fraud-detection
• python

Docker container for Kafka - Spark Streaming - Cassandra

Streaming-first technical indicators with a Rust core: native Python, Node.js and WebAssembly bindings plus a C ABI hub for C, C++, C#, Go, Java and R. 514 indicators, O(1) per-tick updates, no system dependencies. Drop-in TA-Lib replacement.

• algotrading
• backtesting
• bollinger-bands
• cryptocurrency