1.DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
Ranked by Attention Score: stars gained over the last 7 complete days
38 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
The Apache Kafka C/C++ library
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
The open source and enterprise-ready webhooks service 🦀
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
Distributed stream processing engine in Rust
Building event-driven applications the easy way in Go.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Open-Source Web UI for Apache Kafka Management
专注大数据学习面试,大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
A framework for building messaging apps with .NET and C#.
🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
Python Streaming DataFrames for Kafka
大数据入门指南 :star:
【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!
Full-stack .Net 10 Clean Architecture (Microservices, Modular Monolith, Monolith), Blazor, Angular 22, React 19, Vue 3.5, BFF with YARP, NextJs 16, Domain-Driven Design, CQRS, SOLID, Asp.Net Core Identity Custom Storage, OpenID Connect, EF Core, OpenTelemetry, SignalR, Background Services, Health Checks, Rate Limiting, Clouds (Azure, AWS, GCP), ...
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
C++ Parallel Computing and Asynchronous Networking Framework
Fancy stream processing made operationally mundane
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
Confluent Schema Registry for Kafka
Ruby and Rails efficient Kafka processing framework
A lightweight stream processing library for Go
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Fast and reliable message broker built on top of Kafka.
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
Low-code tool for automating actions on real time data | Stream processing for the users.
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Java SDK for CloudEvents
Modern Reactive CQRS Architecture Microservice development framework based on DDD and EventSourcing | 基于 DDD & EventSourcing 的现代响应式 CQRS 架构微服务开发框架