ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
- autodiff
- deep-learning
- machine-learning
- rust
Single C file, Realtime CPU/GPU Profiler with Remote Web Viewer
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
- vulkan
- vulkan-compute
- vulkan-example
- vulkan-tutorial
Vulkan/CUDA/HIP/OpenCL/Level Zero/Metal Fast Fourier Transform library
- vulkan
- fft
- convolution
- r2c
VUDA is a header-only library based on Vulkan that provides a CUDA Runtime API interface for writing GPU-accelerated applications.
Vulkan, OptiX and CUDA Interoperation Modular Rendering Library and Framework for PC/Linux/Android
- vulkan
- raytracing
- graphics-engine
- graphics-library
Edit photos by describing the change, on your own GPU. A free, open-source alternative to Nano Banana and ChatGPT image editing: photos stay on your computer, no daily limit. One installer for Windows, Mac and Linux sets up the best open model (Qwen-Image 2.1). MCP server for AI agents.
- image-editing
- image-generation
- local-ai
- macos
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.