Repository Index

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

• airflow
• apache
• apache-airflow
• python

Node-based Visual Programming Toolbox

• photogrammetry
• computer-vision
• 3d-reconstruction
• alicevision

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam

Ultra-high performance reactive programming

Compositional, streaming I/O library for Scala

• scala
• stream
• streaming-computation
• fp

👜 Tiny and fast reactive/iterable programming library

• callbacks
• reactive
• iterables
• observables

Probabilistic data structures for processing continuous, unbounded streams.

• bloom-filter
• go
• stable-bloom-filters
• cuckoo-filter

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

• hpc
• workflow
• workflow-automation
• workflow-management

🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications

• event-driven
• generics
• go
• golang

Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match

A refined core library for D programming language. The module has concurrency / collections / event / io / logging / text / serialization and more.

• event-driven
• asynchronous
• io
• concurrency

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

A simple embeddable scripting language which supports concurrent event processing.

• interpreter
• language
• embeddable-scripting-language
• object-oriented-programming

Functional Programming for EcmaScript(Javascript)

• functional-programming
• fp
• js
• es

Stream Processing Made Easy

• machine-learning
• reactive-programming
• kafka
• reactive-systems

EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.

• dotnet
• dotnet-core
• etl
• etl-framework

Stateful actors on Apache Flink 2.x and Java 21 — durable per-key state, exactly-once messaging, Kafka and Kinesis I/O, Kubernetes-native deployment. Continues the Apache Stateful Functions programming model on the modern Flink line.

• actor-model
• apache-flink
• distributed-systems
• event-driven

Json-values allows Java developers to harness the power of persistent data structures when working with JSON data, simplifying complex data manipulation. It provides a purely functional approach to JSON

• functional-programming
• java
• json
• json-generator