Repository Index

A realtime distributed messaging platform

• go
• messaging
• distributed-systems
• queue

High-Performance server for NATS.io, the cloud and edge native messaging system.

• go
• golang
• messaging
• message-bus

Apache Pulsar - distributed pub-sub messaging system

• pulsar
• pubsub
• messaging
• streaming

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

• filesystem
• cloud-native
• golang
• redis

Full Modular Monolith application with Domain-Driven Design approach.

• ddd
• ddd-architecture
• cqrs
• architecture

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

• java
• presto
• hive
• hadoop

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

• relational-database
• message-broker
• hadoop-ecosystem
• nosql

A distributed, fast open-source graph database featuring horizontal scalability and high availability

• graph-database
• distributed
• database
• graphdb

🪓 An orchestration engine for background tasks, AI agents, and durable workflows

• event-driven
• golang
• workflow-engine
• distributed

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

• data-drift
• jupyter-notebook
• pandas-dataframe
• machine-learning

Arkime is an open source, large scale, full packet capturing, indexing, and database system.

• network-monitoring
• pcap
• packet-capture
• nsm

Python Stream Processing

• kafka-streams
• kafka
• python
• asyncio

Golang client for NATS, the cloud native messaging system.

• go
• golang
• nats
• microservices

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

• java
• hazelcast
• in-memory
• big-data

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

• rust
• database
• sql
• streaming

An Open-Source Collection of Flash Cards to Help You Preparing Your Algorithms & Data Structures and System Design Interviews 💯

• algorithms
• data-structures
• array
• bit-manipulation

lakeFS - Data version control for your data lake | Git for data

• data-engineering
• data-versioning
• go
• object-storage

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

• asyncio
• kafka
• python
• rabbitmq

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

• cloud-native
• streaming
• rust
• real-time

Distributed stream processing engine in Rust

• data
• dev-tools
• infrastructure
• kafka

An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.

• erlang
• golang
• elixir
• supervisor

Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.

• distributed-systems
• async-await
• durable-execution
• microservices

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.

• messaging
• authentication
• key-management
• identity

A network event stream processing system, in Clojure.

• riemann
• events
• clojure
• monitoring