1.binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
+2,562 stars
from 72,719 · score 7.85
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
53 repositories by Attention Score · Aug 5, 2026 – Nov 2, 2026 (UTC)
2.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+1,853 stars
from 48,855 · score 7.53
3.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+758 stars
from 43,624 · score 6.63
4.thingsboard / thingsboard
All-in-one IoT Platform - Device management, data collection, processing and visualization.
+525 stars
from 22,107 · score 6.27
5.andkret / Cookbook
The Data Engineering Cookbook
+362 stars
from 15,162 · score 5.89
6.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+329 stars
from 13,061 · score 5.80
7.quickwit-oss / quickwit
Cloud-native OSS search engine for observability
+326 stars
from 11,432 · score 5.79
8.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+295 stars
from 11,930 · score 5.69
+280 stars
from 26,160 · score 5.64
10.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
+195 stars
from 1,243 · score 5.28
11.feast-dev / feast
The Open Source Feature Store for AI/ML
+180 stars
from 7,172 · score 5.20
12.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
+166 stars
from 29,220 · score 5.12
13.catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
+161 stars
from 9,025 · score 5.09
14.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+160 stars
from 8,905 · score 5.08
15.vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
+159 stars
from 12,305 · score 5.08
16.arkime / arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
+137 stars
from 7,417 · score 4.93
17.heibaiying / BigData-Notes
大数据入门指南 :star:
+126 stars
from 16,866 · score 4.84
18.provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
+119 stars
from 12,194 · score 4.79
19.cython / cython
The most widely used Python to C compiler
+116 stars
from 10,775 · score 4.76
20.amark / gun
An open source cybersecurity protocol for syncing decentralized graph data.
+92 stars
from 19,067 · score 4.53
21.apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
+88 stars
from 8,616 · score 4.49
22.apache / couchdb
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
+85 stars
from 6,912 · score 4.45
23.prestodb / presto
The official home of the Presto distributed SQL query engine for big data
+77 stars
from 16,688 · score 4.36
24.apache / hugegraph
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
+67 stars
from 3,129 · score 4.22
25.apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
+66 stars
from 2,098 · score 4.20
26.h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
+49 stars
from 7,471 · score 3.91
27.hazelcast / hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
+45 stars
from 6,582 · score 3.83
28.microsoft / SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
+35 stars
from 5,217 · score 3.58
29.apache / ignite
Apache Ignite
+30 stars
from 5,061 · score 3.43
30.matanolabs / matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
+20 stars
from 1,687 · score 3.04
31.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
+18 stars
from 1,194 · score 2.94
32.apache / predictionioArchived
PredictionIO, a machine learning server for developers and ML engineers.
+17 stars
from 12,500 · score 2.89
33.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+14 stars
from 11,904 · score 2.71
34.reductstore / reductstore
High-performance, time-indexed object storage for robotics and industrial IoT
+12 stars
from 364 · score 2.56
35.unum-cloud / UStore
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
+10 stars
from 636 · score 2.40
36.gvinciguerra / PGM-index
🏅State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes
+7 stars
from 871 · score 2.08
37.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
+7 stars
from 738 · score 2.08
38.bigdatagenomics / adam
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
+6 stars
from 1,054 · score 1.95
39.FeatureBaseDB / featurebaseArchived
A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase
+5 stars
from 2,520 · score 1.79
40.Netflix / genie
Distributed Big Data Orchestration Service
+5 stars
from 1,763 · score 1.79
41.databricks / koalas
Koalas: pandas API on Apache Spark
+4 stars
from 3,367 · score 1.61
42.PierreCapo / treeviz
Tree diagrams with JavaScript :evergreen_tree: :chart_with_upwards_trend:
+4 stars
from 172 · score 1.61
43.h2oai / sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
+3 stars
from 979 · score 1.39
44.gchq / GafferArchived
A large-scale entity and relation database supporting aggregation of properties
+2 stars
from 1,786 · score 1.10
45.ankurchavda / SparkLearning
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
+2 stars
from 686 · score 1.10
46.uxlfoundation / oneDAL
oneAPI Data Analytics Library (oneDAL)
+2 stars
from 651 · score 1.10
47.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
+2 stars
from 157 · score 1.10
48.Steema / TeeBI
Data-mining and Visualization components for RAD Studio
+2 stars
from 150 · score 1.10
49.groda / big_data
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
+2 stars
from 87 · score 1.10
50.hazelcast / hazelcast-jetArchived
Distributed Stream and Batch Processing
+1 stars
from 1,110 · score 0.69
51.seung-lab / cloud-volume
Read and write Neuroglancer datasets programmatically.
+1 stars
from 175 · score 0.69
52.eosrio / hyperion-history-api
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
+1 stars
from 135 · score 0.69
53.ambster-public / awesome-qlik
A curated list of awesome Qlik extensions and resources for Qlik Sense and QlikView
+1 stars
from 78 · score 0.69