Apache Spark - A unified analytics engine for large-scale data processing
- python
- scala
- r
- java
Repository Index
47,133 repositories indexed
1–24 of 53 · Most stars
Apache Flink
All-in-one IoT Platform - Device management, data collection, processing and visualization.
- visualization
- iot
- iot-platform
- mqtt
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
- java
- presto
- hive
- hadoop
A distributed, fast open-source graph database featuring horizontal scalability and high availability
Open-Source Web UI for Apache Kafka Management
- kafka-ui
- kafka-brokers
- kafka
- kafka-streams
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
CMAK is a tool for managing Apache Kafka clusters
Cloud-native OSS search engine for observability
- rust
- log-management
- logs
- tantivy
The most widely used Python to C compiler
- python
- cython
- cpython
- cpython-extensions
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Apache Beam is a unified programming model for Batch and Streaming data processing.
- python
- java
- big-data
- beam
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
- java
- hazelcast
- in-memory
- big-data
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Apache Ignite
- distributed-sql-database
- iot
- osgi
- network-client
Koalas: pandas API on Apache Spark
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
- database
- graph-database
- graph
- gremlin
Apache DataFusion Ballista Distributed Query Engine
- arrow
- big-data
- dataframe
- olap