MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
132,241 visible repositories in the index
1–24 of 24 · Most stars
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
C++ tensors with broadcasting and lazy computing
A modern high-performance open source message queuing system
Extremely fast, in memory, serialization, reflection, and RPC library for C++. JSON, BEVE, BSON, CBOR, CSV, JSONB, MessagePack, TOML, YAML, EETF
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
library for importing functions from dlls in a hidden, reverse engineer unfriendly way
A blazing fast display driver for SPI-based LCD displays for Raspberry Pi A, B, 2, 3, 4 and Zero
Colorizing text editor for ImGui
A blazing fast language for the blazing fast world(WIP)
Blazing fast library to create a functional, on-device dashboard for ESP32, RP2040+W and RP2350+W microcontrollers
Sound As Pure Form - a Forth-like language for audio synthesis using lazy lists and APL-like auto-mapping.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
Qt-oriented static code analyzer based on the Clang framework
Real time semantic slam in ROS with a hand held RGB-D camera
Lazy evaluation in C++ - http://jscheiny.github.io/Streams/
The open-source tool for creating 3D models
Fast CSV parser and writer for Modern C++
A C++ header-only library of statistical distribution functions.
Lanes is a lightweight, native, lazy evaluating multithreading library for Lua 5.1 to 5.5.
The repository host gives no description.
C++11 (and onwards) library for lazy evaluation
A fast, lightweight and single-header C++ csv parser library