Open Data Platform for analysts, quants and AI agents.
- python
- machine-learning
- finance
- stocks
95,842 visible repositories in the index
1–24 of 25 · Most stars
Open Data Platform for analysts, quants and AI agents.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Graph-Native Infrastructure for Context and Accountable AI Systems
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines
A system for agentic LLM-powered data processing and ETL
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Scalable and efficient data transformation framework - backwards compatible with dbt.
Django application and library for importing and exporting data with admin integration.
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
Python CLI utility and library for manipulating SQLite databases
Scalable data pre processing and curation toolkit for LLMs
Python Streaming DataFrames for Kafka
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Postgres, MySQL, or MariaDB to Elasticsearch/OpenSearch sync
Reverse ETL for the code-first data stack