Open Data Platform for analysts, quants and AI agents.
- python
- machine-learning
- finance
- stocks
132,241 visible repositories in the index
1–24 of 281 · Most stars
Open Data Platform for analysts, quants and AI agents.
SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Node-based Visual Programming Toolbox
Open-Source Web UI for Apache Kafka Management
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
Apache Iceberg
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Broadcast, Presence, and Postgres Changes via WebSockets
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
deepstream.io server
Dockerfile for Apache Kafka
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.