Open Data Platform for analysts, quants and AI agents.
- python
- machine-learning
- finance
- stocks
103,113 visible repositories in the index
1–24 of 46 · Most stars
Open Data Platform for analysts, quants and AI agents.
SubQuery is an Open, Flexible, Fast and Universal data indexing framework for web3. Our mission is to help developers create the decentralised products of the future.
Graph-Native Semantic Layer for Trustworthy Enterprise AI
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
TranslatedDataX integrated with a visual page: select a data source and generate a data synchronization task with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, and MongoDB, and batch creation of RDBMS data synchronization tasks. Integrates an open-source scheduling system, and supports distributed and incremental data synchronization, real-time viewing of running logs, monitoring of executor resources, KILL of running processes, encryption of data source information, and more.
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
Privacy and Security focused Segment-alternative, in Golang and React
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
深圳地铁大数据客流分析系统🚇🚄🌟
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
Python Streaming DataFrames for Kafka
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Apache InLong - a one-stop, full-scenario integration framework for massive data
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.