1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
- pandas-profiling
- pandas-dataframe
- statistics
- jupyter-notebook
Repository Index
47,133 repositories indexed
1–19 of 19 · Most stars
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
the portable Python dataframe library
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
Koalas: pandas API on Apache Spark
Lightweight and extensible compatibility layer between dataframe libraries!
Distributed Deep learning with Keras & Spark
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Jupyter magics and kernels for working with remote Spark clusters
PySpark + Scikit-learn = Sparkit-learn
PySpark test helper methods with beautiful error messages
pyspark methods to enhance developer productivity 📣 👯 🎉
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
A command-line tool for launching Apache Spark clusters.
- apache-spark
- ec2
- apache-spark-cluster
- orchestration
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
- pandas
- pandas-summary
- dataframes
- data-science
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
- apache-iceberg
- apache-spark
- data-engineering
- delta-lake
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
- data-science
- data-processing
- python
- apache-spark
Joblib Apache Spark Backend
Helpers & syntactic sugar for PySpark.