Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
- workflow
- governance
- azkaban
- davinci
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
EventMesh is a new generation serverless event middleware for building distributed event-driven applications.
- esb
- event-driven
- event-mesh
- event-governance
🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
Hopsworks - Data-Intensive AI platform with a Feature Store
- feature-store
- aws
- azure
- data-science
The MongoDB Spark Connector
Microservices library - scalecube-services is a high throughput, low latency reactive microservices library built to scale. It features: API-Gateways, service-discovery, service-load-balancing, the architecture supports plug-and-play service communication modules and features. built to provide performance and low-latency real-time stream-processing
- microservices
- reactive-streams
- distributed-systems
- service-mesh
Event Sourcing and CQRS in practice.
- event-sourcing
- cqrs
- ddd
- domain-driven-design
Sample ES/CQRS application
- domain-driven-design
- event-sourcing
- event-driven
- cqrs
Implementation of Partitioning Around Medoids (PAM) in H2O-3
- clustering
- machine-learning
- h2o-3
- java