Repository Index

PHP ETL - parquet library

A type-safe queue for background tasks using PocketBase.

• background-jobs
• pocketbase
• queue
• typescript

Lightweight SQL-based stream processing engine for IoT edge.

• edge-analytics
• edge-computing
• iot
• sql

PHP bindings for Tarantool Queue.

• tarantool
• queue
• php
• nosql

A library that brings useful functions from various modern database management systems to Apache Spark

• spark
• postgres
• presto
• hive

Stream database events from PostgreSQL to Kafka

• postgresql
• events
• stream
• kafka

Helpers & syntactic sugar for PySpark.

• spark
• pyspark
• python

An asynchronous event-driven network framework( port netty ) written in D.

• dlang
• network
• event-driven
• asynchronous

Pipelines using goroutines

• pipeline
• go
• concurrency

Flume plugin for RabbitMQ

• flume
• rabbitmq

Background job processing for Common Lisp

• common-lisp
• message-queue

A lightweight Snowflake emulator built with Go and DuckDB for local development and testing

• cicd
• database
• docker
• duckdb

🐇 CLI tool for websockets and Go package

• sockets
• golang
• go
• network

Parallelize _anything_ //

• ocaml-library
• parallel-computing
• stream-processing
• multi-processing

Message Broker for IoT/Mobile/Web. Mainly uses MQTT v3.x and v5. Aims to be easy to use, scalable and reliable

• mqtt
• mqtt-server
• iot
• hacktoberfest

Fast implementation of queue in OCaml

• queue
• ocaml
• gadt

Open-source streaming SQL engine written in Rust using Apache Arrow and DataFusion. Supports continuous queries, temporal stream joins, tumbling/session windows, and CDC/Kafka connectors. Lightweight, embeddable, and sub-microsecond latency

Unlimited job queue for go, using a pool of concurrent workers processing the job queue entries

• queue
• worker
• go
• rabbitmq

Stream Ops is a fully embeddable data streaming engine and stream processing API for Java.

A micro workers class that easily manages a pool of threads to optimise simultaneous jobs and jobs endings, for MicroPython (used on Pycom modules & ESP32)

• pycom
• micropython
• lopy
• wipy

Apache AVRO for go

• avro
• go
• golang
• apache

A library to build and execute typed scientific workflows

• ocaml
• bioinformatics
• computational-biology
• workflow

☝️ go-graphql subscription over Kafka/Redis/NSQ example

• go
• graphql
• graphql-subscriptions
• kafka

Ordered-concurrently a library for concurrent processing with ordered output in Go. Process work concurrently and returns output in a channel in the order of input. It is useful in concurrently processing items in a queue, and get output in the order provided by the queue.

• concurrent
• golang
• golang-library
• data-science