DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Repository Index
47,133 repositories indexed
25–48 of 72 · Most stars
REST job server for Apache Spark
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Apache Spark to Apache Cassandra connector
A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).
Elassandra = Elasticsearch + Apache Cassandra
Distributed Deep learning with Keras & Spark
MLeap: Deploy ML Pipelines to Production
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Jupyter magics and kernels for working with remote Spark clusters
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster
Sparkling Water provides H2O functionality inside Spark cluster
R interface for Apache Spark
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Essential Spark extensions and helper methods ✨😲
The MongoDB Spark Connector
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x