Repository Index

Utils for streaming large files (S3, HDFS, gzip, bz2...)

• python
• s3
• hdfs
• webhdfs

KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.

• mysql-operator
• mongodb-operator
• postgresql-operator
• rabbitmq-operator

Kubernetes-native platform to run massively parallel data/streaming jobs

• kubernetes
• stream-processing
• data-processing
• k8s

Kafka-style message streaming in Go. Built on NATS. Single binary, no JVM, no ZooKeeper.

• nats
• streaming
• messaging
• cloud-native

music streaming server / free-software subsonic server API implementation

• subsonic
• go
• golang
• subsonic-server

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

• flogo
• iot
• integration
• golang

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

• spark
• csharp
• dotnet
• analytics

Lua HTTP client cosocket driver for OpenResty / ngx_lua.

• openresty
• http-client
• lua
• nginx

Python Stream Processing. A Faust fork

• asyncio
• python-streaming
• kafka
• redis

EventMesh is a new generation serverless event middleware for building distributed event-driven applications.

• esb
• event-driven
• event-mesh
• event-governance

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

• actor-model
• cloud-native
• concurrency
• distributed-actors

Stream Processing and Complex Event Processing Engine

• streaming-data-processing
• cep
• stream-processing
• complex-event-processing

Fast, concurrent, streaming access to Amazon S3, including gof3r, a CLI. http://godoc.org/github.com/rlmcpherson/s3gof3r

An extensible distributed system for reliable nearline data streaming at scale

• distributed-systems
• data-streaming
• scalability
• kafka-mirror-maker

Smart IP camera stream finder. Tests 102K+ URL patterns in 30 seconds. Supports 67K camera models. Generates ready Frigate/go2rtc configs.

• camera-discovery
• cctv
• docker
• frigate

Self-hosted torrent video streaming service compatible with Chromecast, AppleTV & Kodi deployable in the cloud

• streaming-video
• p2p
• torrent
• torrent-stream

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

• streaming
• database
• iot
• stream-processing

Self-hosted version of webtor.io implemented as an all-in-one Docker image

• bittorrent
• hls
• self-hosted
• stremio-addon

.NET polycloud storage framework which provides a unified polycloud API across 15+ clouds for Object manipulation, File uploads/downloads, File streaming/seeking, Directory upload/download, Object metadata, Versioning, Tags, Storage tier/class, Presigned URLs and more.

• abstraction
• aws
• aws-s3
• aws-sqs

Go AI SDK, the Go way. One unified API across 21+ providers. Streaming, structured output, MCP support, stdlib only. Go AI SDK for AI applications inspired by Vercel AI SDK.

• ai
• ai-agents
• ai-tools
• llm

Cloud-native continuous backup for PostgreSQL - WAL/base-backup streaming, compression, encryption, retention, and monitoring in a single binary.

• backup
• cloud-native
• golang
• postgresql

Machine is a workflow/pipeline library for processing data

• golang
• golang-library
• golang-package
• workflow

Cloud Download Manager for direct links and media files from Youtube/Spotify/etc with media converter and builtin proxy to bypass restrictions

• cloud
• csharp
• downloader
• blazor

Docker container for Kafka - Spark Streaming - Cassandra