Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Repository Index
47,133 repositories indexed
1–21 of 21 · Most stars
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
the portable Python dataframe library
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
Koalas: pandas API on Apache Spark
Lightweight and extensible compatibility layer between dataframe libraries!
Distributed Deep learning with Keras & Spark
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Jupyter magics and kernels for working with remote Spark clusters
PySpark + Scikit-learn = Sparkit-learn
PySpark test helper methods with beautiful error messages
pyspark methods to enhance developer productivity 📣 👯 🎉
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
A command-line tool for launching Apache Spark clusters.
- apache-spark
- ec2
- apache-spark-cluster
- orchestration
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
- pandas
- pandas-summary
- dataframes
- data-science
Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.
- apache-iceberg
- apache-spark
- data-engineering
- delta-lake
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
- data-science
- data-processing
- python
- apache-spark
Joblib Apache Spark Backend
Helpers & syntactic sugar for PySpark.