Repository Index

Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

• kafka
• diskless
• automq
• serverless

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

• cloud-native
• streaming
• rust
• real-time

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

• flogo
• iot
• integration
• golang

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• spark
• hive
• sql
• thrift

Build Amazon Simple Queue Service (SQS) based applications without the boilerplate

• sqs
• nodejs
• ignorearchive
• aws-sqs

EventMesh is a new generation serverless event middleware for building distributed event-driven applications.

• esb
• event-driven
• event-mesh
• event-governance

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

• aws
• cloud
• security
• big-data

Hopsworks - Data-Intensive AI platform with a Feature Store

• feature-store
• aws
• azure
• data-science

JSON-RPC 2.0 implementation over WebSockets for Node.js and JavaScript/TypeScript

• rpc-api
• rpc-framework
• rpc-client
• rpc-server

Booster Framework

• serverless
• cloud-native
• booster-framework
• typescript

Spawn - Actor Mesh

• actorsystem
• concurrency
• distributed-systems
• kubernetes

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

Read and write Neuroglancer datasets programmatically.

• neuroglancer
• volumetric-data
• python
• cloud

:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

• aws
• textract
• lambda
• dynamodb

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt

Real-time P2P messenger using go-ipfs pubsub. TUI. End-to-end encrypted texting & file-sharing. NAT traversal.

• p2p
• tui
• ipfs
• pubsub

Build and deploy a serverless data pipeline on AWS with no effort.

• aws-cdk
• data-pipeline
• stepfunctions
• glue

Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.

• aws-cdk
• aws-codepipeline
• cra-pipeline
• react

Stateful actors on Apache Flink 2.x and Java 21 — durable per-key state, exactly-once messaging, Kafka and Kinesis I/O, Kubernetes-native deployment. Continues the Apache Stateful Functions programming model on the modern Flink line.

• actor-model
• apache-flink
• distributed-systems
• event-driven