Open Data Platform for analysts, quants and AI agents.
- python
- machine-learning
- finance
- stocks
111,821 visible repositories in the index
1–24 of 26 · Most stars
Open Data Platform for analysts, quants and AI agents.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Neo4j graph construction from unstructured data using LLMs
Cartography is a Python tool that pulls infrastructure assets and their relationships into a Neo4j graph database.
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Spring Batch is a framework for writing batch applications using Java and Spring
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
Python Streaming DataFrames for Kafka
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)
Sync your Stripe account to you Postgres database.
MetaForge is integrated software for data transformation, integration, and visualization. Support a variety of data sources, file types, big data related database, relational database, NoSQL database, etc. Through the software can realize the management of multiple data sources, the data under the source of various operations conversion, making dat
:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
High performance Kafka consumer for InfluxDB. Supports collectd message formats.
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
Event-driven OneLake pipeline with automated Upsert merge and Python reporting