Repository Index

Cross-platform, customizable ML solutions for live and streaming media.

• mediapipe
• c-plus-plus
• computer-vision
• deep-learning

ncnn is a high-performance neural network inference framework optimized for the mobile platform

• inference
• high-preformance
• simd
• arm-neon

Universal LLM Deployment Engine with ML Compilation

• llm
• machine-learning-compilation
• language-model
• tvm

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

• deep-learning
• onnx
• neural-networks
• machine-learning

High-performance In-browser LLM Inference Engine

• deep-learning
• llm
• tvm
• webgpu

A WebGL accelerated JavaScript library for training and deploying ML models.

• deep-learning
• typescript
• webgl
• javascript

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

• mnn
• convolution
• vulkan
• embedded-devices

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

• tensorrt
• nvidia
• deep-learning
• inference

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

• inference
• deep-learning
• openvino
• ai

Production ready toolkit to run AI locally

• ios
• kotlin
• llm
• swift

Run Keras models in the browser, with GPU support using WebGL

• deep-learning
• machine-learning
• webgl
• tensorflow

Easily craft fast Neural Networks on iOS! Use TensorFlow models. Metal under the hood.

• machine-learning
• neural-networks
• metal
• apple

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

• godot
• godot-engine
• godot-plugin
• godot4

Transpile trained scikit-learn estimators and transformers to C, C#, Go, Java, JavaScript, PHP and Ruby.

• machine-learning
• data-science
• scikit-learn
• sklearn

A lightweight header-only library for using Keras (TensorFlow) models in C++.

• tensorflow
• deep-learning
• keras
• cpp

Dataflow compiler for QNN inference on FPGAs

• dataflow
• quantization
• fpga
• compiler

Fast multilayer perceptron neural network library for iOS and Mac OS X

SDK to use local models on web easy

• ai-model
• ai-models
• local-ai
• web-ai

Private, unlimited background removal that runs in your browser.

TFLite Support is a toolkit that helps users to develop ML and deploy TFLite models onto mobile / ioT devices.

Laya typed decisions on Linux x86_64 via ONNX Runtime

Tiny world model generates games and stream ac plays them all on Pico 2W

• rust
• transformers

Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy.