ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
99,825 visible repositories in the index
1–24 of 58 · Most stars
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
Matter (formerly Project CHIP) creates more connections between more objects, simplifying development for manufacturers and increasing compatibility for consumers, guided by the Connectivity Standards Alliance.
- standard
- internet-of-things
- iot
- chip
Easy to use device for connecting "old" measuring units (water, power, gas, ...) to the digital world
ESP8266 WiFi Connection manager with web captive portal
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
- amd
- llama
- llm
- llm-inference
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
- obs
- obs-plugin
- libobs
- mac-osx
Tengine is a lite, high performance, modular inference engine for embedded device
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
- yolox
- onnxruntime
- robustvideomatting
- mnn
Multi-platform app that allows your devices to communicate
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
A retargetable MLIR-based machine learning compiler and runtime toolkit.
- mlir
- vulkan
- tensorflow
- spirv
Re-Connectable secure remote shell
Motion planning and Navigation of AGV/AMR:ROS planner plugin implementation of A*, JPS, D*, LPA*, D* Lite, Theta*, RRT, RRT*, RRT-Connect, Informed RRT*, ACO, PSO, Voronoi, PID, LQR, MPC, DWA, APF, Pure Pursuit etc.
- astar
- jump-point-search
- motion-planning
- ros
ONNX-TensorRT: TensorRT backend for ONNX
- onnx
- deep-learning
- nvidia
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
C/C++ WebRTC network library featuring Data Channels, Media Transport, and WebSockets
- webrtc
- webrtc-datachannel
- datachannel
- rtcdatachannel
The repository host gives no description.
- ai-sdk
- chat-completions
- foundry-local
- gpu-acceleration
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
- ncnn
- yolov5
- android-app
- mnn
A LiDAR odometry pipeline that just works
- 3d-mapping
- icp
- lidar-slam
- slam
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
Python wrapper to Philipp Krähenbühl's dense (fully connected) CRFs with gaussian edge potentials.
- computer-vision
- machine-learning
- crf
- pairwise-potentials
A native macOS / windows / Linux database IDE built with Swift and AppKit. Connect to PostgreSQL, MySQL, SQLite, and Redis from a single app with a fast, keyboard-driven interface.
Redis client written in C++
- redis-client
- redis
- c-plus-plus
- cpp