the portable Python dataframe library
Repository Index
47,133 repositories indexed
1–17 of 17 · Most stars
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
State of the Art Natural Language Processing
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
Lightweight and extensible compatibility layer between dataframe libraries!
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Jupyter magics and kernels for working with remote Spark clusters
Hopsworks - Data-Intensive AI platform with a Feature Store
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Sparkling Water provides H2O functionality inside Spark cluster
PySpark test helper methods with beautiful error messages
pyspark methods to enhance developer productivity 📣 👯 🎉
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
Helpers & syntactic sugar for PySpark.