Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Repository Index
47,133 repositories indexed
25–48 of 142 · Most stars
Pentaho Data Integration ( ETL ) a.k.a Kettle
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
🍴 Web applications made easy. Since 2011.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
Upserts, Deletes And Incremental Processing on Big Data.
- hudi
- apachehudi
- datalake
- bigdata
Highly scalable realtime pub/sub and RPC framework
📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
- java
- thread-pool
- dynamic
- monitor
The polyglot queue: Fast and reliable background jobs in Go, Java, JS, Ruby, and Rust on Postgres/SQLite.
- background-jobs
- go
- golang
- postgres
An Open-Source Collection of Flash Cards to Help You Preparing Your Algorithms & Data Structures and System Design Interviews 💯
- algorithms
- data-structures
- array
- bit-manipulation
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
- asyncapi
- reactive
- specification
- websockets
Apache Ignite
- distributed-sql-database
- iot
- osgi
- network-client
Franz is a free messaging app for services like WhatsApp, Slack, Messenger and many more.
Maxwell's daemon, a mysql-to-json kafka producer
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
- java
- bitset
- roaring-bitmaps
- roaringbitmap
Micro second messaging that stores everything to disk
- chronicle
- queue
- java
- performance
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
- datalake
- lakehouse
- metadata
- federated-query
Apache Avro is a data serialization system.
- csharp
- ruby
- cplusplus
- python
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
- workflow
- governance
- azkaban
- davinci
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
- database
- graph-database
- graph
- gremlin