MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
47,133 repositories indexed
1–7 of 7 · Most stars
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
Vulkan/CUDA/HIP/OpenCL/Level Zero/Metal Fast Fourier Transform library
A lightweight header-only library for using Keras (TensorFlow) models in C++.
:dancer: Real-time single person pose estimation for Android and iOS.
Learning Multi-Domain Convolutional Neural Networks for Visual Tracking
⚡ Open-source software for deep learning-based digital pathology