Repository Index

Apache Superset is a Data Visualization and Data Exploration Platform

• superset
• apache
• apache-superset
• data-visualization

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

• airflow
• apache
• apache-airflow
• python

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

• python
• workflow
• data-engineering
• data-science

An orchestration platform for the development, production, and observation of data assets.

• data-pipelines
• dagster
• workflow
• data-science

Always know what to expect from your data.

• pipeline-tests
• dataquality
• datacleaning
• datacleaner

The Open Source Feature Store for AI/ML

• machine-learning
• features
• ml
• big-data

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

• python
• aws
• pandas
• apache-arrow

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering