MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
Repository Index
74,860 visible repositories in the index
1–7 of 7 · Most stars
A modern high-performance open source message queuing system
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
- vulkan
- vulkan-compute
- vulkan-example
- vulkan-tutorial
BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
- rapidsai
- sql
- python
- machine-learning
Blazing fast library to create a functional, on-device dashboard for ESP32, RP2040+W and RP2350+W microcontrollers
- ui
- library
- arduino
- dashboard
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
- apple-silicon
- clover
- coding-agents
- decision-models
Fast CSV parser and writer for Modern C++
- csv-parser
- single-threaded
- mit-license
- header-only