The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
Repository Index
47,133 repositories indexed
1–24 of 60 · Most stars
ClickHouse® is a real-time analytics database management system
Apache Spark - A unified analytics engine for large-scale data processing
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Apache Flink
All-in-one IoT Platform - Device management, data collection, processing and visualization.
An open source cybersecurity protocol for syncing decentralized graph data.
大数据入门指南 :star:
The official home of the Presto distributed SQL query engine for big data
The Data Engineering Cookbook
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
A distributed, fast open-source graph database featuring horizontal scalability and high availability
Open-Source Web UI for Apache Kafka Management
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
CMAK is a tool for managing Apache Kafka clusters
Cloud-native OSS search engine for observability
The most widely used Python to C compiler
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache Beam is a unified programming model for Batch and Streaming data processing.
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
The Open Source Feature Store for AI/ML