Open Data Platform for analysts, quants and AI agents.
- python
- machine-learning
- finance
- stocks
89,572 visible repositories in the index
1–24 of 27 · Most stars
Open Data Platform for analysts, quants and AI agents.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Graph-Native Infrastructure for Context and Accountable AI Systems
🧙 Build, run, and manage data pipelines for integrating and transforming data.
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Scalable and efficient data transformation framework - backwards compatible with dbt.
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Scalable data pre processing and curation toolkit for LLMs
Extract Transform Load for Python 3.5+
Python Streaming DataFrames for Kafka
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
A decision-model-based ontology & knowledge-graph builder — builds governed knowledge graphs from your documents, every fact gated and traceable to its evidence.