87,075 visible repositories in the index
25–48 of 82 · Most stars
The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.
Contentlayer turns your content into data - making it super easy to import MD(X) and CMS content in your app
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
LFX Community Data Platform (CDP)
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
sq data wrangler
A high-performance Postgres replication engine written in Rust. Embed it in your Rust application or run it as a standalone binary.
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.
superglue's AI agents connect, migrate and implement enterprise systems. Cloud-hosted or on your own infrastructure.
Markdown 批量导出工具、开放式跨平台博客解决方案，随意组合写作平台(语雀/Notion/FlowUs/飞书/我来Wolai)和博客平台(Hexo/Vitepress/Halo/Confluence/WordPress等)
Scalable data pre processing and curation toolkit for LLMs
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.
Python Streaming DataFrames for Kafka
Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 426 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
visual data prep powered by python
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊