1.binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
+4,910 stars
from 70,371 · score 8.50
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
54 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.ClickHouse / ClickHouse
ClickHouse® is a real-time analytics database management system
+3,821 stars
from 46,887 · score 8.25
3.apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
+1,390 stars
from 42,992 · score 7.24
4.thingsboard / thingsboard
All-in-one IoT Platform - Device management, data collection, processing and visualization.
+1,108 stars
from 21,524 · score 7.01
5.trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
+679 stars
from 12,711 · score 6.52
6.StarRocks / starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
+656 stars
from 11,569 · score 6.49
7.quickwit-oss / quickwit
Cloud-native OSS search engine for observability
+655 stars
from 11,103 · score 6.49
+606 stars
from 25,834 · score 6.41
9.andkret / Cookbook
The Data Engineering Cookbook
+524 stars
from 15,000 · score 6.26
10.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
+472 stars
from 28,914 · score 6.16
11.feast-dev / feast
The Open Source Feature Store for AI/ML
+385 stars
from 6,967 · score 5.96
12.vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
+362 stars
from 12,102 · score 5.89
13.provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
+344 stars
from 11,969 · score 5.84
14.delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
+342 stars
from 8,723 · score 5.84
15.catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
+318 stars
from 8,868 · score 5.77
16.heibaiying / BigData-Notes
大数据入门指南 :star:
+254 stars
from 16,738 · score 5.54
17.cython / cython
The most widely used Python to C compiler
+253 stars
from 10,638 · score 5.54
18.apache / cloudberry
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
+237 stars
from 1,201 · score 5.47
19.arkime / arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
+226 stars
from 7,328 · score 5.42
20.amark / gun
An open source cybersecurity protocol for syncing decentralized graph data.
+193 stars
from 18,966 · score 5.27
21.apache / beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
+175 stars
from 8,529 · score 5.17
22.apache / couchdb
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
+160 stars
from 6,837 · score 5.08
23.prestodb / presto
The official home of the Presto distributed SQL query engine for big data
+151 stars
from 16,614 · score 5.02
24.apache / datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
+148 stars
from 2,016 · score 5.00
25.apache / hugegraph
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
+127 stars
from 3,069 · score 4.85
26.h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
+98 stars
from 7,422 · score 4.60
27.hazelcast / hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
+97 stars
from 6,530 · score 4.58
28.reductstore / reductstore
High-performance, time-indexed object storage for robotics and industrial IoT
+89 stars
from 287 · score 4.50
29.microsoft / SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
+55 stars
from 5,197 · score 4.03
30.apache / ignite
Apache Ignite
+50 stars
from 5,041 · score 3.93
31.graphframes / graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
+43 stars
from 1,169 · score 3.78
32.matanolabs / matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
+41 stars
from 1,666 · score 3.74
33.yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
+39 stars
from 11,879 · score 3.69
34.apache / predictionioArchived
PredictionIO, a machine learning server for developers and ML engineers.
+37 stars
from 12,480 · score 3.64
35.TouK / nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
+24 stars
from 721 · score 3.22
36.bigdatagenomics / adam
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
+17 stars
from 1,043 · score 2.89
37.unum-cloud / UStore
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
+16 stars
from 630 · score 2.83
38.databricks / koalas
Koalas: pandas API on Apache Spark
+13 stars
from 3,358 · score 2.64
39.gvinciguerra / PGM-index
🏅State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes
+13 stars
from 865 · score 2.64
40.Netflix / genie
Distributed Big Data Orchestration Service
+9 stars
from 1,759 · score 2.30
41.FeatureBaseDB / featurebaseArchived
A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase
+7 stars
from 2,518 · score 2.08
42.uxlfoundation / oneDAL
oneAPI Data Analytics Library (oneDAL)
+7 stars
from 646 · score 2.08
43.h2oai / sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
+6 stars
from 976 · score 1.95
+6 stars
from 838 · score 1.95
45.groda / big_data
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
+6 stars
from 83 · score 1.95
46.PierreCapo / treeviz
Tree diagrams with JavaScript :evergreen_tree: :chart_with_upwards_trend:
+5 stars
from 171 · score 1.79
47.gchq / GafferArchived
A large-scale entity and relation database supporting aggregation of properties
+4 stars
from 1,784 · score 1.61
48.archivesunleashed / aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
+4 stars
from 155 · score 1.61
49.Steema / TeeBI
Data-mining and Visualization components for RAD Studio
+4 stars
from 148 · score 1.61
50.ankurchavda / SparkLearning
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
+3 stars
from 685 · score 1.39
51.Hydrospheredata / mist
Serverless proxy for Spark cluster
+2 stars
from 323 · score 1.10
52.eosrio / hyperion-history-api
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
+2 stars
from 134 · score 1.10
53.hazelcast / hazelcast-jetArchived
Distributed Stream and Batch Processing
+1 stars
from 1,110 · score 0.69
54.CogComp / cogcomp-nlp
CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.
+1 stars
from 478 · score 0.69