1.rustfs / rustfs
RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
+5,190 stars
from 30,434 · score 8.55
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
1–100 of 543 by Attention Score · Aug 5, 2026 – Nov 2, 2026 (UTC)
2.permissionlesstech / bitchat
bluetooth mesh chat, IRC vibes
+2,803 stars
from 34,246 · score 7.94
3.kestra-io / kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
- automation
- devops
- +14 more
+2,742 stars
from 27,365 · score 7.92
4.binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
- system-design
- backend
- scalability
- interview
- architecture
- devops
- +14 more
+2,562 stars
from 72,719 · score 7.85
5.DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
- data-engineering
- kafka
- spark
- dbt
- docker
- kestra
- +2 more
+2,469 stars
from 44,113 · score 7.81
6.binwiederhier / ntfy
Send push notifications to your phone or desktop using PUT/POST
+2,321 stars
from 32,898 · score 7.75
7.DataExpert-io / data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
+2,075 stars
from 42,847 · score 7.64
8.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+1,853 stars
from 48,855 · score 7.53
9.redis / redis
For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.
+1,565 stars
from 75,568 · score 7.36
10.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+1,460 stars
from 73,927 · score 7.29
11.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+1,343 stars
from 27,275 · score 7.20
12.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+1,293 stars
from 22,104 · score 7.17
13.google-ai-edge / mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
- mediapipe
- c-plus-plus
- computer-vision
- deep-learning
- android
- video-processing
- +11 more
+1,129 stars
from 36,376 · score 7.03
14.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+1,113 stars
from 46,230 · score 7.02
15.GokuMohandas / Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
+1,086 stars
from 48,806 · score 6.99
16.aklivity / zilla
🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
+1,002 stars
from 689 · score 6.91
17.dragonflydb / dragonfly
A modern replacement for Redis and Memcached
+985 stars
from 30,854 · score 6.89
18.macrozheng / mall
mall项目是一套电商系统，包括前台商城系统及后台管理系统，基于Spring Boot+MyBatis实现，采用Docker容器化部署。 前台商城系统包含首页门户、商品推荐、商品搜索、商品展示、购物车、订单流程、会员中心、客户服务、帮助中心等模块。 后台管理系统包含商品管理、订单管理、会员管理、促销管理、运营管理、内容管理、统计报表、财务管理、权限管理、设置等模块。
- spring-boot
- spring-security
- mybatis
- docker
- swagger-ui
- mysql
- +10 more
+872 stars
from 84,127 · score 6.77
19.ModernRelay / omnigraph
Object-storage native graph database with branching and typed ontology
- apache-arrow
- datafusion
- graph-database
- knowledge-graph
- lakehouse
- lance
- +5 more
+865 stars
from 1,006 · score 6.76
20.dagucloud / dagu
Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
- cron
- workflow-engine
- workflow-scheduler
- workflow-orchestration
- devops
- data-pipeline
- +14 more
+855 stars
from 3,672 · score 6.75
21.eugeneyan / applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
- applied-machine-learning
- production
- applied-data-science
- machine-learning
- data-science
- reinforcement-learning
- +8 more
+853 stars
from 29,913 · score 6.75
22.apache / kafka
Apache Kafka - A distributed event streaming platform
+831 stars
from 33,278 · score 6.72
23.apache / iggy
Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed
+771 stars
from 4,459 · score 6.65
24.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+758 stars
from 43,624 · score 6.63
25.argoproj / argo-cd
Declarative Continuous Deployment for Kubernetes
+753 stars
from 23,756 · score 6.63
26.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- +14 more
+695 stars
from 11,110 · score 6.55
27.simplex-chat / simplex-chat
SimpleX - the first messaging network operating without user identifiers of any kind - 100% private by design! iOS, Android and desktop apps 📱!
+659 stars
from 18,965 · score 6.49
28.slothflowlabs / duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
- duckdb
- elt
- +14 more
+655 stars
from 886 · score 6.49
29.nats-io / nats-server
High-Performance server for NATS.io, the cloud and edge native messaging system.
- go
- golang
- messaging
- message-bus
- message-queue
- cloud-native
- +9 more
+648 stars
from 20,331 · score 6.48
30.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+637 stars
from 23,468 · score 6.46
31.AutoMQ / automq
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
- kafka
- diskless
- automq
- serverless
+581 stars
from 10,338 · score 6.37
32.dbt-labs / dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
- dbt-viewpoint
- slack
- pypa
- data-modeling
- business-intelligence
- analytics
- +1 more
+580 stars
from 13,528 · score 6.36
33.hatchet-dev / hatchet
🪓 An orchestration engine for background tasks, AI agents, and durable workflows
+570 stars
from 7,641 · score 6.35
34.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+565 stars
from 21,730 · score 6.34
35.vectordotdev / vector
A high-performance observability data pipeline.
- logs
- metrics
- observability
- forwarder
- events
- stream-processing
- +12 more
+556 stars
from 22,230 · score 6.32
36.thingsboard / thingsboard
All-in-one IoT Platform - Device management, data collection, processing and visualization.
- visualization
- iot
- iot-platform
- mqtt
- middleware
- thingsboard
- +12 more
+525 stars
from 22,107 · score 6.27
37.apache / doris
Apache Doris is a real-time analytics and hybrid search database for AI agents.
+498 stars
from 15,664 · score 6.21
38.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+481 stars
from 15,880 · score 6.18
39.growthbook / growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
- abtesting
- statistics
- abtest
- experimentation
- split-testing
- snowflake
- +14 more
+474 stars
from 8,082 · score 6.16
40.Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
- ocr
- information-retrieval
- +14 more
+451 stars
from 15,207 · score 6.11
41.restatedev / restate
Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
- distributed-systems
- async-await
- durable-execution
- microservices
- consistent-state
- reliable-communication
- +4 more
+409 stars
from 4,232 · score 6.02
42.centrifugal / centrifugo
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
+390 stars
from 10,551 · score 5.97
43.projectdiscovery / httpx
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
- http
- bugbounty
- ssl-certificate
- pipeline
- pentest-tool
- cybersecurity
- +4 more
+376 stars
from 10,193 · score 5.93
44.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+364 stars
from 5,681 · score 5.90
45.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+362 stars
from 15,162 · score 5.89
46.juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
+360 stars
from 14,235 · score 5.89
47.taskforcesh / bullmq
BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL
- background-jobs
- nodejs
- queue
- redis
- typescript
- python
- +3 more
+359 stars
from 9,207 · score 5.89
48.doocs / advanced-java
😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识
- java
- distributed-systems
- message-queue
- redis
- distributed-search-engine
- high-availability
- +14 more
+356 stars
from 78,815 · score 5.88
49.riverqueue / river
The polyglot queue: Fast and reliable background jobs in Go, Java, JS, Ruby, and Rust on Postgres/SQLite.
- background-jobs
- go
- golang
- postgres
- postgresql
- queue
- +5 more
+354 stars
from 5,492 · score 5.87
50.debezium / debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
- change-data-capture
- kafka-connect
- apache-kafka
- debezium
- cdc
- database
- +5 more
+350 stars
from 12,952 · score 5.86
51.inngest / inngest
The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.
- cli
- event-driven
- serverless-functions
- queues
- serverless
- event-driven-architecture
- +2 more
+345 stars
from 5,667 · score 5.85
52.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+329 stars
from 13,061 · score 5.80
53.questdb / questdb
QuestDB is a high performance, open-source, time-series database
- time-series
- low-latency
- database
- sql
- questdb
- tsdb
- +14 more
+326 stars
from 17,167 · score 5.79
54.quickwit-oss / quickwit
Cloud-native OSS search engine for observability
- rust
- log-management
- logs
- tantivy
- cloud-native
- open-source
- +4 more
+326 stars
from 11,432 · score 5.79
55.emqx / emqx
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
+325 stars
from 16,548 · score 5.79
56.pgmq / pgmq
A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.
+324 stars
from 5,044 · score 5.78
57.timgit / pg-boss
Queueing jobs in Postgres from Node.js like a boss
+306 stars
from 3,811 · score 5.73
58.madd86 / awesome-system-design
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
- relational-database
- message-broker
- hadoop-ecosystem
- nosql
- interview
- distributed-systems
- +3 more
+298 stars
from 12,347 · score 5.70
59.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+295 stars
from 11,930 · score 5.69
60.kedacore / keda
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
- kubernetes
- serverless
- autoscaling
- event-driven
- keda
- hacktoberfest
+295 stars
from 10,390 · score 5.69
61.apache / seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
- apache
- batch
- +8 more
+288 stars
from 9,491 · score 5.67
62.evidence-dev / evidence
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
+281 stars
from 6,798 · score 5.64
+280 stars
from 26,160 · score 5.64
64.tobymao / sqlglot
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
- optimizer
- bigquery
- +14 more
+273 stars
from 9,470 · score 5.61
65.redpanda-data / redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
- kafka
- cpp
- kubernetes
- go
- streaming
- redpanda
- +7 more
+272 stars
from 12,379 · score 5.61
66.evidentlyai / evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
- model-monitoring
- html-report
- +8 more
+269 stars
from 7,760 · score 5.60
67.eclipse-mosquitto / mosquitto
Eclipse Mosquitto - An open source MQTT broker
+256 stars
from 11,064 · score 5.55
68.online-ml / river
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
- online-statistics
- data-science
- +6 more
+255 stars
from 5,886 · score 5.55
69.apache / gravitino
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
- datalake
- lakehouse
- metadata
- federated-query
- stratosphere
- metalake
- +5 more
+254 stars
from 3,085 · score 5.54
70.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+248 stars
from 11,664 · score 5.52
71.argoproj / argo-workflows
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
- knative
- airflow
- +12 more
+241 stars
from 16,836 · score 5.49
72.lightdash / lightdash
Agentic BI. Analytics at the speed of code ⚡️
+240 stars
from 5,978 · score 5.48
73.pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
+238 stars
from 61,789 · score 5.48
74.kgrzybek / modular-monolith-with-ddd
Full Modular Monolith application with Domain-Driven Design approach.
+238 stars
from 13,871 · score 5.48
75.yeasy / docker_practice
最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!
- docker
- book
- cloud-computing
- container
- kubernetes
- swarm
- +5 more
+236 stars
from 26,105 · score 5.47
76.openimsdk / open-im-server
IM Chat OpenClaw
+234 stars
from 16,507 · score 5.46
77.dapr / dapr
Dapr is a portable runtime for building distributed applications across cloud and edge, combining event-driven architecture with workflow orchestration.
+232 stars
from 25,940 · score 5.45
78.oxnr / awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
- awesome
- bigdata
- data-warehouse
- data-analytics
- data-visualization
- data-stream
- +9 more
+231 stars
from 14,482 · score 5.45
79.bruin-data / ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
- data-pipeline
- duckdb
- +4 more
+221 stars
from 3,819 · score 5.40
80.taosdata / TDengine
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
- iot
- bigdata
- time-series
- database
- industrial-iot
- connected-vehicles
- +11 more
+219 stars
from 24,963 · score 5.39
81.influxdata / telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
- telegraf
- monitoring
- time-series
- metrics
- golang
- influxdb
- +10 more
+213 stars
from 17,679 · score 5.37
82.risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
- database
- stream-processing
- rust
- postgresql
- kafka
- materialized-view
- +5 more
+201 stars
from 9,195 · score 5.31
83.rabbitmq / rabbitmq-server
Open source RabbitMQ: core server and tier 1 (built-in) plugins
+199 stars
from 13,753 · score 5.30
84.PipedreamHQ / pipedream
Connect APIs, remarkably fast. Free for developers.
- eventsourcing
- event-sourcing
- automation
- workflow
- workflows
- apis
- +13 more
+199 stars
from 11,568 · score 5.30
85.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
- database
- data-analysis
- data-warehouse
- olap
- postgresql
- sql
- +8 more
+195 stars
from 1,243 · score 5.28
86.getredash / redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
- redash
- python
- visualization
- analytics
- bi
- redshift
- +13 more
+192 stars
from 28,663 · score 5.26
87.aeron-io / aeron
Efficient reliable UDP unicast, UDP multicast, and IPC message transport
- messaging
- java
- c-plus-plus
- ipc
- multicast-streams
- c
+191 stars
from 8,749 · score 5.26
88.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+180 stars
from 7,172 · score 5.20
89.apache / dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- workflow-schedule
- azkaban
- airflow
- task-scheduler
- job-scheduler
- cloud-native
- +5 more
+177 stars
from 14,373 · score 5.18
90.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+169 stars
from 19,284 · score 5.14
91.macrozheng / mall-swarm
mall-swarm是一套微服务商城系统，采用了 Spring Cloud Alibaba、Spring Boot 3.5、Sa-Token、MyBatis、Elasticsearch、Docker、Kubernetes等核心技术，同时提供了基于Vue的管理后台方便快速搭建系统。mall-swarm在电商业务的基础集成了注册中心、配置中心、监控中心、网关等系统功能。
- springcloud
- springboot
- docker
- java
- mysql
- elasticsearch
- +8 more
+168 stars
from 13,027 · score 5.13
92.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
- python
- machine-learning
- deep-learning
- data-science
- big-data
- aws
- +13 more
+166 stars
from 29,220 · score 5.12
93.catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
- gbdt
- python
- +12 more
+161 stars
from 9,025 · score 5.09
94.tinode / chat
Instant messaging platform. Backend in Go. Clients: Swift iOS, Java Android, JS webapp, scriptable command line; chatbots
- chat
- chat-application
- chatapp
- go
- golang
- instant-messaging
- +14 more
+160 stars
from 13,387 · score 5.08
95.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+160 stars
from 8,905 · score 5.08
96.vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
- graph-database
- distributed
- database
- graphdb
- raft
- cpp
- +11 more
+159 stars
from 12,305 · score 5.08
97.apache / rocketmq
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
- rocketmq
- cloud-native
- eventing
- java
- messaging
- streaming
- +1 more
+158 stars
from 22,488 · score 5.07
98.apache / hudi
Upserts, Deletes And Incremental Processing on Big Data.
- hudi
- apachehudi
- datalake
- bigdata
- apachespark
- incremental-processing
- +3 more
+153 stars
from 6,192 · score 5.04
99.svix / svix-webhooks
The open source and enterprise-ready webhooks service 🦀
- webhooks
- rust
- webhook-server
- webhook-service
- webhook
- webhooks-server
- +13 more
+153 stars
from 3,320 · score 5.04
100.bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
- python
- snowflake
- +5 more
+150 stars
from 1,648 · score 5.02