Repository Index

Apache Kafka - A distributed event streaming platform

• scala
• kafka
• java
• streaming

一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024

• spring-boot
• spring-cloud
• spring-cloud-alibaba
• dubbo

大数据入门指南 :star:

• hadoop
• hdfs
• yarn
• mapreduce

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

• flink
• kafka
• elasticsearch
• spark

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

• change-data-capture
• kafka-connect
• apache-kafka
• debezium

Open-Source Web UI for Apache Kafka Management

• kafka-ui
• kafka-brokers
• kafka
• kafka-streams

Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

• kafka
• diskless
• automq
• serverless

Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.

• camel
• integration
• java
• microservices

📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.

• java
• thread-pool
• dynamic
• monitor

Maxwell's daemon, a mysql-to-json kafka producer

Confluent Schema Registry for Kafka

• schema-registry
• kafka
• schema
• schemas

JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter

• java
• agent
• profiler
• performance

🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.

• kafka
• rest
• server-sent-events
• streaming-api

zerocode-tdd is a community-developed, free, open-source, outcome-driven automated testing framework for Data Pipelines, ETL, REST API, Kafka(Data Streams), Databases and Load scenarios. all defined in simple JSON or YAML — with zero coding.

• soap
• assertions
• java
• api

An extensible distributed system for reliable nearline data streaming at scale

• distributed-systems
• data-streaming
• scalability
• kafka-mirror-maker

Fast and reliable message broker built on top of Kafka.

• hermes
• kafka
• pubsub
• messaging

The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.

• broker
• iot
• java
• kafka

Java SDK for CloudEvents

• cloudevents
• java-api
• kafka
• sdk-java

LittleHorse Server: Business-as-Code Platform for Microservices, Workflows, and Agents

• microservices
• workflow-engine
• orchestration
• apache-kafka

A Relational Database Backed by Apache Kafka

An HTTP bridge for Apache Kafka®

• bridge
• kafka
• kafka-bridge
• http

Kroxylicious, the snappy open source proxy for Apache Kafka®

• apache-kafka
• java
• kafka
• proxy

The database purpose-built for stream processing applications.

• stream-processing
• real-time
• sql
• interactive

Reactive Kafka Client for Vert.x