Kubernetes-native platform to run massively parallel data/streaming jobs
- kubernetes
- stream-processing
- data-processing
- k8s
47,133 repositories indexed
97–120 of 332 · Most stars
Kubernetes-native platform to run massively parallel data/streaming jobs
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
High-performance time-series aggregation for PostgreSQL
Little command line REST client that you can use in pipelines (bash or zsh).
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Machine learning platform for Web developers
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
Ruby on Rails API documentation tool
A curated list of awesome OpenGL libraries, debuggers and resources.
A LiDAR odometry pipeline that just works
HTML processing filters and utilities
Translated【A common used C++ & Python DAG framework】 A general-purpose, third-party-dependency-free, cross-platform parallel computing framework based on flow graphs, listed in awesome-cpp. Welcome to star & fork & discuss
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
A lightweight stream processing library for Go
CLI task management & automation tool
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Elyra extends JupyterLab with an AI centric approach.
A full spaCy pipeline and models for scientific/biomedical documents.
Nix User Repository: User contributed nix packages [maintainer=@Pandapip1]
Testable, composable, and adapter based Elixir email library for devs that love piping.
Azure Pipelines Agent 🚀
Composable concurrency toolkit for Go
Go HardWare discovery/inspection library
MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)