Repository Index

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

• deep-learning
• document-parsing
• machine-learning
• nlp

Build, Manage and Deploy AI/ML Systems

• machine-learning
• model-management
• ai
• ml

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

• steampipe
• postgresql
• postgresql-fdw
• cloud

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

• aws
• gcp
• azure
• sql

Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

• cdc
• tidb
• mysql
• kafka

Enhanced PostgreSQL logical replication

• postgresql
• logical-replication
• golang

Graph-based security analysis for everyone

• gcp
• graph
• aws
• security

Machine is a workflow/pipeline library for processing data

• golang
• golang-library
• golang-package
• workflow

Google Pub/Sub client for Elixir

• pubsub
• google-cloud-pubsub
• google-cloud-platform
• gcp

ETL scripts for EOS.

• eos
• eosio
• etl
• apache-beam