Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Lightweight and extensible compatibility layer between dataframe libraries!
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
- apache-spark
- big-data
- connected-components
- dataframe
PySpark + Scikit-learn = Sparkit-learn
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
pyspark methods to enhance developer productivity 📣 👯 🎉
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
- data-science
- data-processing
- python
- apache-spark
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Helpers & syntactic sugar for PySpark.
Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archives Unleashed Toolkit.
- notebooks
- pyspark-notebook
- juypter-notebook
- spark