Sign in

Repository Index

97,836 visible repositories in the index

Tags: Data orchestration
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–12 of 12 · Most stars

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  • python
  • luigi
  • orchestration-framework
  • scheduling

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

  • kedro
  • hacktoberfest
  • mlops
  • python

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

  • version-control
  • experiment-manager
  • version
  • control

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

  • analytics
  • bigquery
  • data-modeling
  • data-pipelines

A column-oriented approach to feature engineering. Feature engineering and machine learning: together at last!