Apache Spark - A unified analytics engine for large-scale data processing
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Apache Flink
The Data Engineering Cookbook
The most widely used Python to C compiler
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
Apache Beam is a unified programming model for Batch and Streaming data processing.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
The Open Source Feature Store for AI/ML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Koalas: pandas API on Apache Spark
Apache DataFusion Ballista Distributed Query Engine
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
Read and write Neuroglancer datasets programmatically.
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.