Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- batch-processing
- kafka
- pathway
- python
Repository Index
47,133 repositories indexed
1–24 of 37 · Most stars
ClickHouse® is a real-time analytics database management system
Extremely fast Query Engine for DataFrames, written in Rust
- dataframe-library
- dataframe
- dataframes
- rust
Scalable datastore for metrics, events, and real-time analytics
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics
GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
- bigquery
- duckdb
- llm
- postgresql
This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable, and secure AI workflows from session setup to service orchestration.
- csharp
- java
- javascript
- mcp
Count your code, quickly.
- tokei
- cloc
- badge
- rust
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
- dbt-viewpoint
- slack
- pypa
- data-modeling
Visualize, query, and stream to train on multimodal robotics data.
A data visualization and analytics component, especially well-suited for large and/or streaming datasets.
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy
- json
- python
- rust
- serialization
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
- csv
- data-wrangling
- opendata
- data-engineering
Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖
Transform ML models into a native code (Java, C, Python, Go, JavaScript, Visual Basic, C#, R, PowerShell, PHP, Dart, Haskell, Ruby, F#, Rust) with zero dependencies
- machine-learning
- scikit-learn
- statistical-learning
- xgboost
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
- ai
- fairness-ai
- fairness
- fairness-testing
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐
Blazingly fast analytics database that will rapidly devour all of your data.
Plotly for Rust
- plot
- rust
- chart
- financial
Real-time network monitor + outbound firewall — see & block every connection. Privacy-first, local-first, Rust fleet agent, SIEM exports, 8 languages. / Moniteur réseau temps réel + pare-feu sortant, agent de flotte Rust, exports SIEM. 100 % local.
🍇 GRAPE is a Rust/Python Graph Representation Learning library for Predictions and Evaluations
- graph
- high-performance
- machine-learning
- knowledge-graph