Repository Index

Open Data Platform for analysts, quants and AI agents.

• python
• machine-learning
• finance
• stocks

Graph-Native Infrastructure for Context and Accountable AI Systems

• ai
• ai-governance
• artificial-intelligence
• context-engineering

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

• ai-agents
• data-engineering
• document-ai
• generative-ai

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

• data-analysis
• data-science
• large-language-models
• llm

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

• machine-learning
• convolutional-networks
• embedding-vectors
• embeddings

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

• claude-code
• codex
• data-processing
• harness-engineering

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

• unstructured-data
• low-code
• developer-tools
• etl

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

• dataprep
• data-science
• datapreparation
• dataconnector

Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.

• iot
• iot-gateway
• gateway
• mqtt

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• spark
• pyspark
• data-wrangling
• bigdata

The data transformation tool the open-source community deserves.

• data-engineering
• duckdb
• data-lineage
• data-pipeline

A decision-model-based ontology & knowledge-graph builder — builds governed knowledge graphs from your documents, every fact gated and traceable to its evidence.

• graphrag
• information-extraction
• knowledge-graph
• llm

Code to download, process, and analyse the Online Encyclopedia of Integer Sequences

Reverse ETL for the code-first data stack

• bigquery
• cli
• data-engineering
• dbt

Real-time GTFS database loader and ORM library.