1.binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
+871 stars
from 74,410 · score 6.77
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
48 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
2.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+558 stars
from 50,150 · score 6.33
3.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+314 stars
from 44,068 · score 5.75
4.thingsboard / thingsboard
All-in-one IoT Platform - Device management, data collection, processing and visualization.
+152 stars
from 22,480 · score 5.03
5.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+102 stars
from 13,288 · score 4.63
+86 stars
from 26,354 · score 4.47
7.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+84 stars
from 12,141 · score 4.44
8.quickwit-oss / quickwit
Cloud-native OSS search engine for observability
+80 stars
from 11,678 · score 4.39
9.andkret / Cookbook
The Data Engineering Cookbook
+76 stars
from 15,448 · score 4.34
10.vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
+64 stars
from 12,400 · score 4.17
11.catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
+64 stars
from 9,122 · score 4.17
12.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
+46 stars
from 29,340 · score 3.85
13.cython / cython
The most widely used Python to C compiler
+43 stars
from 10,848 · score 3.78
14.feast-dev / feast
The Open Source Feature Store for AI/ML
+41 stars
from 7,311 · score 3.74
15.arkime / arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
+40 stars
from 7,514 · score 3.71
16.heibaiying / BigData-Notes
大数据入门指南 :star:
+39 stars
from 16,953 · score 3.69
17.apache / couchdb
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
+38 stars
from 6,959 · score 3.66
18.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+35 stars
from 9,030 · score 3.58
19.apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
+33 stars
from 8,671 · score 3.53
20.amark / gun
An open source cybersecurity protocol for syncing decentralized graph data.
+32 stars
from 19,127 · score 3.50
21.provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
+29 stars
from 12,284 · score 3.40
22.apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
+22 stars
from 2,142 · score 3.14
23.hazelcast / hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
+20 stars
from 6,607 · score 3.04
24.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
+20 stars
from 1,418 · score 3.04
25.prestodb / presto
The official home of the Presto distributed SQL query engine for big data
+18 stars
from 16,747 · score 2.94
26.h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
+16 stars
from 7,504 · score 2.83
27.microsoft / SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
+11 stars
from 5,241 · score 2.48
28.apache / ignite
Apache Ignite
+11 stars
from 5,080 · score 2.48
29.apache / hugegraph
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
+10 stars
from 3,186 · score 2.40
30.matanolabs / matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
+9 stars
from 1,698 · score 2.30
31.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+5 stars
from 11,913 · score 1.79
32.unum-cloud / UStore
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
+5 stars
from 641 · score 1.79
33.FeatureBaseDB / featurebaseArchived
A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase
+4 stars
from 2,521 · score 1.61
34.gvinciguerra / PGM-index
🏅State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes
+4 stars
from 874 · score 1.61
35.apache / predictionioArchived
PredictionIO, a machine learning server for developers and ML engineers.
+3 stars
from 12,514 · score 1.39
36.Netflix / genie
Distributed Big Data Orchestration Service
+3 stars
from 1,765 · score 1.39
37.reductstore / reductstore
High-performance, time-indexed object storage for robotics and industrial IoT
+3 stars
from 373 · score 1.39
38.gchq / GafferArchived
A large-scale entity and relation database supporting aggregation of properties
+2 stars
from 1,786 · score 1.10
39.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
+2 stars
from 1,210 · score 1.10
40.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
+2 stars
from 743 · score 1.10
41.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
+2 stars
from 157 · score 1.10
42.databricks / koalas
Koalas: pandas API on Apache Spark
+1 stars
from 3,370 · score 0.69
43.hazelcast / hazelcast-jetArchived
Distributed Stream and Batch Processing
+1 stars
from 1,110 · score 0.69
44.ankurchavda / SparkLearning
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
+1 stars
from 687 · score 0.69
45.uxlfoundation / oneDAL
oneAPI Data Analytics Library (oneDAL)
+1 stars
from 652 · score 0.69
46.seung-lab / cloud-volume
Read and write Neuroglancer datasets programmatically.
+1 stars
from 175 · score 0.69
47.groda / big_data
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
+1 stars
from 88 · score 0.69
48.ambster-public / awesome-qlik
A curated list of awesome Qlik extensions and resources for Qlik Sense and QlikView
+1 stars
from 78 · score 0.69