Sign in

Repository Index

142,273 visible repositories in the index

Tags: Data pipelines and messaging
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–24 of 252 · Most stars

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

  • metadata
  • datadiscovery
  • dataquality
  • data-profiling

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

  • workflow-schedule
  • azkaban
  • airflow
  • task-scheduler

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

  • dbt-viewpoint
  • slack
  • pypa
  • data-modeling

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

  • data-integration
  • high-performance
  • offline
  • real-time

Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

  • version-control
  • experiment-manager
  • version
  • control