Repository Index

All-in-one IoT Platform - Device management, data collection, processing and visualization.

• visualization
• iot
• iot-platform
• mqtt

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

• kafka
• cpp
• kubernetes
• go

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

• relational-database
• message-broker
• hadoop-ecosystem
• nosql

Fast and secure standalone server for resizing, processing, and converting images on the fly

• image
• resize-images
• crop-image
• microservice

thumbor is an open-source photo thumbnail service by globo.com

• hacktoberfest
• avif
• crop-image
• docker

Python Stream Processing

• kafka-streams
• kafka
• python
• asyncio

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

• java
• hazelcast
• in-memory
• big-data

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

• rust
• database
• sql
• streaming

Fast, simple, scalable, Docker-ready HTTP microservice for high-level image processing

• image
• image-processing
• resize-images
• libvips

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

• cloud-native
• streaming
• rust
• real-time

Distributed stream processing engine in Rust

• data
• dev-tools
• infrastructure
• kafka

Fast, secure image processing server and Go library, using libvips

• docker
• jpeg
• png
• libvips

Accelerated deep learning R&D

• deep-learning
• reinforcement-learning
• machine-learning
• computer-vision

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

• etl
• sql
• bigquery
• cloud-native

Kubernetes-native platform to run massively parallel data/streaming jobs

• kubernetes
• stream-processing
• data-processing
• k8s

Python Stream Processing. A Faust fork

• asyncio
• python-streaming
• kafka
• redis

Damselfly is a server-based Photograph Management app. The goal of Damselfly is to index an extremely large collection of images, and allow easy search and retrieval of those images, using metadata such as the IPTC keyword tags, as well as the folder and file names. Damselfly includes support for object/face detection.

• photography
• docker
• image
• image-processing

Stream Processing and Complex Event Processing Engine

• streaming-data-processing
• cep
• stream-processing
• complex-event-processing

Fastest end-to-end CSV ingestion for Ruby (with C acceleration). SmarterCSV auto-detects formats, applies smart defaults, and returns Rails-ready hashes for seamless use with ActiveRecord, Sidekiq, parallel jobs, and S3 pipelines — even for messy user-uploaded real-world data.

• csv
• csv-converter
• csv-export
• csv-file

MLBox is a powerful Automated Machine Learning python library.

• machine-learning
• auto-ml
• kaggle
• deep-learning

NFF-Go -Network Function Framework for GO (former YANFF)

• dpdk
• golang
• networking
• vnf

IoTSharp is an open-source IoT platform for data collection, processing, visualization, and device management.

• visualization
• iot-platform
• iot-cloud
• iotsharp

Framework for building Event-Driven Microservices

• microservices
• messaging
• event-driven-microservices
• stream-processing