Repository Index

Parallel computing with task scheduling

• dask
• python
• pydata
• numpy

Real-time monitor and web admin for Celery distributed task queue

• celery
• task-queue
• monitoring
• administration

CLI task management & automation tool

• python
• build-tool
• build-automation
• task-runner

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• spark
• pyspark
• data-wrangling
• bigdata

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

• python
• pandas
• spark
• data

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

• pandas
• pandas-summary
• dataframes
• data-science

BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.

• postgresql
• python
• queue
• sqlalchemy

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

• etl
• etl-framework
• etl-pipeline
• python