Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
132,241 visible repositories in the index
1–16 of 16 · Most stars
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
A framework for integrated Artificial Intelligence & Artificial General Intelligence (AGI)
Self-hosted realtime soundscape analyser for birds, bats and other wildlife. Multi-model local AI inference, runs 24/7 on a Raspberry Pi.
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
The inference module for AgiBot X1.
Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.
Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
Dataflow compiler for QNN inference on FPGAs
Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT
Machine Learning inference engine for Microcontrollers and Embedded devices
Embedded and mobile deep learning research resources
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Bayesian Generalized Kernel Inference for Terrain Traversability Mapping
ROS wrapper for NCNN neural inference framework