ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Repository Index
47,133 repositories indexed
1–15 of 15 · Most stars
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.
Open source real-time translation app for Android that runs locally
- translator
- bluetooth-le
- realtime-translator
- android-app
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
VUDA is a header-only library based on Vulkan that provides a CUDA Runtime API interface for writing GPU-accelerated applications.
Thin, unified, C++-flavored wrappers for the CUDA APIs
- api-wrapper
- cuda
- cuda-runtime-api
- modern-cpp
The foundation layer for agentic intelligence.
Laya typed decisions on Linux x86_64 via ONNX Runtime
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
SIMT Abstractions for Runtime Extensible Kernels (GPGPU programing with OCaml)
- spoc
- ocaml
- opencl
- cuda
Push-to-talk voice dictation for Linux. 100% local, multilingual (25+ languages), with speaker diarization. Qt frontend, Rust backend on NVIDIA Parakeet via ONNX Runtime. KDE Plasmoid integrated.
- asr
- linux
- nvidia
- parakeet
The complete toolkit for building AI agents in JavaScript. Lightweight core, React & Terminal UIs, autonomous runtime, tools, skills, memory, RAG and observability. Plug-and-play from chat UI to full agents.
The repository host gives no description.
- artificial-intelligence
- blazor
- face-detection
- face-recognition