1.rustfs / rustfs
RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
+252 stars
from 35,414 · score 5.53
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
1–100 of 140 by Attention Score · Oct 28, 2026 – Nov 3, 2026 (UTC)
2.binwiederhier / ntfy
Send push notifications to your phone or desktop using PUT/POST
+153 stars
from 35,096 · score 5.04
3.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+105 stars
from 50,616 · score 4.66
4.google-ai-edge / mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
- mediapipe
- c-plus-plus
- computer-vision
- deep-learning
- android
- video-processing
- +11 more
+103 stars
from 37,421 · score 4.64
5.kestra-io / kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
- automation
- devops
- +14 more
+103 stars
from 30,021 · score 4.64
6.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+85 stars
from 28,546 · score 4.45
7.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+83 stars
from 23,327 · score 4.43
8.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+68 stars
from 75,323 · score 4.23
9.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+65 stars
from 47,285 · score 4.19
10.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+58 stars
from 44,333 · score 4.08
11.nats-io / nats-server
High-Performance server for NATS.io, the cloud and edge native messaging system.
- go
- golang
- messaging
- message-bus
- message-queue
- cloud-native
- +9 more
+57 stars
from 20,931 · score 4.06
12.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- +14 more
+56 stars
from 11,757 · score 4.04
13.Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
- ocr
- information-retrieval
- +14 more
+45 stars
from 15,628 · score 3.83
14.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+43 stars
from 13,369 · score 3.78
15.argoproj / argo-cd
Declarative Continuous Deployment for Kubernetes
+36 stars
from 24,480 · score 3.61
16.juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
+34 stars
from 14,580 · score 3.56
17.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+33 stars
from 6,017 · score 3.53
18.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+31 stars
from 16,331 · score 3.47
19.debezium / debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
- change-data-capture
- kafka-connect
- apache-kafka
- debezium
- cdc
- database
- +5 more
+31 stars
from 13,276 · score 3.47
20.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+26 stars
from 24,081 · score 3.30
21.apache / doris
Apache Doris is a real-time analytics and hybrid search database for AI agents.
+25 stars
from 16,144 · score 3.26
22.argoproj / argo-workflows
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
- knative
- airflow
- +12 more
+24 stars
from 17,055 · score 3.22
23.dbt-labs / dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
- dbt-viewpoint
- slack
- pypa
- data-modeling
- business-intelligence
- analytics
- +1 more
+24 stars
from 14,087 · score 3.22
24.centrifugal / centrifugo
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
+20 stars
from 10,923 · score 3.04
25.apache / iggy
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
+20 stars
from 5,212 · score 3.04
26.questdb / questdb
QuestDB is a high performance, open-source, time-series database
- time-series
- low-latency
- database
- sql
- questdb
- tsdb
- +14 more
+19 stars
from 17,477 · score 3.00
27.apache / seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
- apache
- batch
- +8 more
+19 stars
from 9,763 · score 3.00
28.evidentlyai / evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
- model-monitoring
- html-report
- +8 more
+19 stars
from 8,012 · score 3.00
+18 stars
from 26,426 · score 2.94
30.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+18 stars
from 12,208 · score 2.94
31.openimsdk / open-im-server
IM Chat OpenClaw
+17 stars
from 16,728 · score 2.89
32.kedacore / keda
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
- kubernetes
- serverless
- autoscaling
- event-driven
- keda
- hacktoberfest
+17 stars
from 10,671 · score 2.89
33.quickwit-oss / quickwit
Cloud-native OSS search engine for observability
- rust
- log-management
- logs
- tantivy
- cloud-native
- open-source
- +4 more
+15 stars
from 11,745 · score 2.77
34.catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
- gbdt
- python
- +12 more
+15 stars
from 9,175 · score 2.77
35.slothflowlabs / duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
- duckdb
- elt
- +14 more
+15 stars
from 1,531 · score 2.77
36.dapr / dapr
Dapr is a portable runtime for building distributed applications across cloud and edge, combining event-driven architecture with workflow orchestration.
+14 stars
from 26,158 · score 2.71
37.apache / dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- workflow-schedule
- azkaban
- airflow
- task-scheduler
- job-scheduler
- cloud-native
- +5 more
+14 stars
from 14,537 · score 2.71
38.macrozheng / mall-swarm
mall-swarm是一套微服务商城系统，采用了 Spring Cloud Alibaba、Spring Boot 3.5、Sa-Token、MyBatis、Elasticsearch、Docker、Kubernetes等核心技术，同时提供了基于Vue的管理后台方便快速搭建系统。mall-swarm在电商业务的基础集成了注册中心、配置中心、监控中心、网关等系统功能。
- springcloud
- springboot
- docker
- java
- mysql
- elasticsearch
- +8 more
+13 stars
from 13,182 · score 2.64
39.vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
- graph-database
- distributed
- database
- graphdb
- raft
- cpp
- +11 more
+12 stars
from 12,452 · score 2.56
40.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+10 stars
from 15,517 · score 2.40
41.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+10 stars
from 11,904 · score 2.40
42.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+10 stars
from 9,056 · score 2.40
43.apache / camel
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
- cloud-native
- data-transformation
- +10 more
+10 stars
from 6,380 · score 2.40
44.bytewax / bytewax
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
- data-processing
- data-science
- +3 more
+10 stars
from 2,060 · score 2.40
+9 stars
from 15,699 · score 2.30
46.cython / cython
The most widely used Python to C compiler
- python
- cython
- cpython
- cpython-extensions
- c
- cpp
- +2 more
+9 stars
from 10,883 · score 2.30
47.risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
- database
- stream-processing
- rust
- postgresql
- kafka
- materialized-view
- +5 more
+9 stars
from 9,389 · score 2.30
48.apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
- batch
- golang
- +2 more
+9 stars
from 8,696 · score 2.30
49.apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
- arrow
- big-data
- dataframe
- olap
- python
- query-engine
- +3 more
+9 stars
from 2,157 · score 2.30
50.bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
- python
- snowflake
- +5 more
+9 stars
from 1,790 · score 2.30
51.apache / couchdb
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
+8 stars
from 6,990 · score 2.20
52.clidey / whodb
Where data access meets operational intelligence
- mysql
- postgresql
- ai-agent
- data-catalog
- data-governance
- data-integration
- +14 more
+8 stars
from 5,042 · score 2.20
53.apache / gravitino
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
- datalake
- lakehouse
- metadata
- federated-query
- stratosphere
- metalake
- +5 more
+8 stars
from 3,332 · score 2.20
54.panjf2000 / gnet
🚀 gnet is a high-performance, lightweight, non-blocking, event-driven networking framework written in pure Go.
- event-driven
- event-loop
- networking
- non-blocking
- epoll
- kqueue
- +10 more
+7 stars
from 11,253 · score 2.08
55.ibis-project / ibis
the portable Python dataframe library
- python
- impala
- pandas
- database
- clickhouse
- postgresql
- +12 more
+7 stars
from 6,682 · score 2.08
56.ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
- asyncio
- kafka
- python
- rabbitmq
- asyncapi
- distributed-systems
- +7 more
+7 stars
from 5,384 · score 2.08
57.microcks / microcks
The open source, cloud native tool for API Mocking and Testing. Microcks is a Cloud Native Computing Foundation incubating project 🚀
+7 stars
from 2,069 · score 2.08
58.redisson / redisson
Redisson: Valkey & Redis Java Client and Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Extends Valkey and Redis with over 60 objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache..
+6 stars
from 24,419 · score 1.95
59.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+6 stars
from 19,448 · score 1.95
60.prestodb / presto
The official home of the Presto distributed SQL query engine for big data
+6 stars
from 16,763 · score 1.95
61.PRQL / prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
+6 stars
from 10,932 · score 1.95
62.aeron-io / aeron
Efficient reliable UDP unicast, UDP multicast, and IPC message transport
- messaging
- java
- c-plus-plus
- ipc
- multicast-streams
- c
+6 stars
from 8,937 · score 1.95
63.arkime / arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
- network-monitoring
- pcap
- packet-capture
- nsm
- javascript
- c
- +2 more
+6 stars
from 7,548 · score 1.95
64.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+6 stars
from 7,347 · score 1.95
65.nats-io / nats.go
Golang client for NATS, the cloud native messaging system.
- go
- golang
- nats
- microservices
- microservices-architecture
- pub-sub
- +3 more
+6 stars
from 6,792 · score 1.95
66.uNetworking / uWebSockets
Simple, secure & standards compliant web server for the most demanding of applications
- websockets
- http
- pubsub
- router
- commercial
- cross-platform
- +1 more
+5 stars
from 19,017 · score 1.79
67.h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
- h2o
- machine-learning
- data-science
- deep-learning
- big-data
- ensemble-learning
- +14 more
+5 stars
from 7,515 · score 1.79
68.asyncapi / spec
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
- asyncapi
- reactive
- specification
- websockets
- amqp
- mqtt
- +2 more
+5 stars
from 5,328 · score 1.79
69.ArroyoSystems / arroyo
Distributed stream processing engine in Rust
- data
- dev-tools
- infrastructure
- kafka
- rust
- sql
- +3 more
+5 stars
from 5,068 · score 1.79
70.apache / hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
- dataframe
- etl
- +13 more
+5 stars
from 2,617 · score 1.79
71.apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
+5 stars
from 2,371 · score 1.79
72.timeplus-io / proton
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- kakfa
- sql
- redpanda
- single-binary
- stream-processing
- +10 more
+5 stars
from 2,275 · score 1.79
73.apache / rocketmq
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
- rocketmq
- cloud-native
- eventing
- java
- messaging
- streaming
- +1 more
+4 stars
from 22,644 · score 1.61
74.krakend / krakend-ce
KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.
- api-gateway
- microservices
- backend-services
- reverse-proxy
- cloud-native
- microservice
- +8 more
+4 stars
from 2,697 · score 1.61
75.eclipse-iceoryx / iceoryx
Eclipse iceoryx™ - true zero-copy inter-process-communication
- iceoryx
- eclipse
- ipc
- inter-process-communication
- cpp
- zero-copy
- +10 more
+4 stars
from 2,202 · score 1.61
76.OpenHFT / Chronicle-Queue
Micro second messaging that stores everything to disk
- chronicle
- queue
- java
- performance
- low-latency
- persistance
+3 stars
from 3,824 · score 1.39
77.vernemq / vernemq
A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases. The VerneMQ mission is active & the project maintained. Thank you for your support!
- mqtt
- m2m
- scalable
- broker
- erlang
- distributed
- +13 more
+3 stars
from 3,643 · score 1.39
+3 stars
from 3,308 · score 1.39
79.softwaremill / elasticmq
In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.
- scala
- sqs-interface
- elasticmq
- amazon-sqs
- aws
- aws-sqs
- +1 more
+3 stars
from 2,950 · score 1.39
80.numaproj / numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
- kubernetes
- stream-processing
- data-processing
- k8s
- pipeline
- map-reduce
- +1 more
+3 stars
from 2,834 · score 1.39
81.quixio / quix-streams
Python Streaming DataFrames for Kafka
+3 stars
from 1,580 · score 1.39
82.apache / streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
- iot
- analytics
- edge
- stream-processing
- iiot
- self-service
- +6 more
+3 stars
from 753 · score 1.39
83.apache / shardingsphere
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
+2 stars
from 20,815 · score 1.10
84.sogou / workflow
C++ Parallel Computing and Asynchronous Networking Framework
+2 stars
from 14,424 · score 1.10
85.provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
- kafka-ui
- kafka-brokers
- kafka
- kafka-streams
- kafka-client
- opensource
- +12 more
+2 stars
from 12,312 · score 1.10
86.MassTransit / MassTransit
Distributed Application Framework for .NET
+2 stars
from 7,811 · score 1.10
87.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+2 stars
from 7,046 · score 1.10
88.apache / hudi
Upserts, Deletes And Incremental Processing on Big Data.
- hudi
- apachehudi
- datalake
- bigdata
- apachespark
- incremental-processing
- +3 more
+2 stars
from 6,344 · score 1.10
89.confluentinc / confluent-kafka-go
Confluent's Apache Kafka Golang client
- confluent
- golang
- golang-library
- golang-bindings
- librdkafka
- kafka-client
- +2 more
+2 stars
from 5,174 · score 1.10
90.apache / ignite
Apache Ignite
- distributed-sql-database
- iot
- osgi
- network-client
- ignite
- data-management-platform
- +9 more
+2 stars
from 5,088 · score 1.10
91.build-trust / ockam
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
- messaging
- authentication
- key-management
- identity
- trust
- kafka
- +12 more
+2 stars
from 4,637 · score 1.10
92.WeBankFinTech / DataSphereStudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
+2 stars
from 3,273 · score 1.10
93.absmach / magistrala
IoT Platform Framework
- golang
- iot-platform
- edge-computing
- distributed-systems
- iot-cloud
- iot-gateway
- +14 more
+2 stars
from 2,656 · score 1.10
94.elyra-ai / elyra
Elyra extends JupyterLab with an AI centric approach.
- notebooks
- notebook-jupyter
- jupyterlab
- jupyterlab-extensions
- ai
- machine-learning
- +14 more
+2 stars
from 2,002 · score 1.10
95.asc-lab / dotnetcore-microservices-poc
Very simplified insurance sales system made in a microservices architecture using .NET Core
- netcore
- dotnet-core
- microservices
- insurance
- ddd
- cqrs
- +11 more
+2 stars
from 1,940 · score 1.10
96.lf-edge / ekuiper
Lightweight data stream processing engine for IoT edge
+2 stars
from 1,743 · score 1.10
97.matanolabs / matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
- aws
- cloud
- security
- big-data
- serverless
- apache-iceberg
- +14 more
+2 stars
from 1,705 · score 1.10
98.projectnessie / nessie
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
- data
- spark
- java
- iceberg
- aws-lambda
- git
+2 stars
from 1,524 · score 1.10
99.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
- database
- data-analysis
- data-warehouse
- olap
- postgresql
- sql
- +8 more
+2 stars
from 1,436 · score 1.10
100.halaxa / json-machine
Efficient, easy-to-use, and fast PHP JSON stream parser
- php
- stream-processing
- json-parser
- json-iterator
- json-stream
- parsing
+2 stars
from 1,332 · score 1.10