Repository Index

Apache Kafka - A distributed event streaming platform

• scala
• kafka
• java
• streaming

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

• rocketmq
• cloud-native
• eventing
• java

Apache Pulsar - distributed pub-sub messaging system

• pulsar
• pubsub
• messaging
• streaming

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

• flink
• kafka
• elasticsearch
• spark

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

• change-data-capture
• kafka-connect
• apache-kafka
• debezium

Open-Source Web UI for Apache Kafka Management

• kafka-ui
• kafka-brokers
• kafka
• kafka-streams

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

• data-integration
• high-performance
• offline
• real-time

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam

JeroMQ is a pure Java implementation of the ZeroMQ messaging library, offering high-performance asynchronous messaging for distributed or concurrent applications.

• jeromq
• libzmq
• messaging
• networking

EventMesh is a new generation serverless event middleware for building distributed event-driven applications.

• esb
• event-driven
• event-mesh
• event-governance

🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.

• kafka
• rest
• server-sent-events
• streaming-api

Stream Processing and Complex Event Processing Engine

• streaming-data-processing
• cep
• stream-processing
• complex-event-processing

An extensible distributed system for reliable nearline data streaming at scale

• distributed-systems
• data-streaming
• scalability
• kafka-mirror-maker

The database purpose-built for stream processing applications.

• stream-processing
• real-time
• sql
• interactive

Stream Ops is a fully embeddable data streaming engine and stream processing API for Java.

Window-Based Hybrid CPU/GPU Stream Processing Engine

• stream-processing
• hybrid
• multicore
• gpu

Develop streaming applications for IBM Streams in Python, Java & Scala.

• ibm-streams
• java
• scala
• python