GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
47,133 repositories indexed
1–24 of 28 · Most stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Xournal++ is a handwriting notetaking software with PDF annotation support. Written in C++ with GTK3, supporting Linux (e.g. Ubuntu, Debian, Arch, SUSE), macOS and Windows 10. Supports pen input from devices such as Wacom Tablets.
Sunshine fork - The easiest way to stream with the native resolution of your client device
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.
Production ready toolkit to run AI locally
Matter (formerly Project CHIP) creates more connections between more objects, simplifying development for manufacturers and increasing compatibility for consumers, guided by the Connectivity Standards Alliance.
Multi-platform app that allows your devices to communicate
Free open source home automation system for Linux, Windows, Raspberry Pi. Supports Z-Wave, Zigbee, MQTT, and 150+ devices.
Infrared remote library for ESP8266/ESP32: send and receive infrared signals with multiple protocols. Based on: https://github.com/shirriff/Arduino-IRremote/
Easy MultiSensor device based on ESP8266/ESP32
Home automation firmware for ESP8266-based devices
deCONZ REST-API plugin to control ZigBee devices
Blazing fast library to create a functional, on-device dashboard for ESP32, RP2040+W and RP2350+W microcontrollers
UPnP Media Server for 2026: Stream your digital media through your home network and consume it on all kinds of UPnP supporting devices 📱💻📺
ROS tools for IMU devices
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
Thin, unified, C++-flavored wrappers for the CUDA APIs
Real-time object detection on Android using the YOLO network with TensorFlow
Asynchronous HTTP/WebSocket graphics device for R with an interactive plot viewer
TFLite Support is a toolkit that helps users to develop ML and deploy TFLite models onto mobile / ioT devices.
MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.
Async node.js interface to Blackmagic Design capture and playback devices.
A cross-platform Vulkan layer which checks Vulkan applications for best practices on Arm Mali devices.