ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
47,133 repositories indexed
1–24 of 33 · Most stars
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
High-performance In-browser LLM Inference Engine
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
- tensorrt
- nvidia
- deep-learning
- inference
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
- inference
- deep-learning
- openvino
- ai
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
- yolox
- yolov3
- onnx
- tensorrt
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.
TranslatedHigh-performance · Lightweight · AI Native Video workspace. A video creation workspace for the AI era. On the canvas, freely connect ideas and materials together with the Agent.
- ai-image-generation
- ai-video
- ai-video-generation
- ai-workspace
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
- reinforcement-learning
- parallel-processing
- cpp17
- pybind11
An engine for high performance multi-agent environments with very large numbers of agents, along with a set of reference environments
OpenFE: automated feature generation with expert-level performance
🍇 GRAPE is a Rust/Python Graph Representation Learning library for Predictions and Evaluations
- graph
- high-performance
- machine-learning
- knowledge-graph
High-performance, time-indexed object storage for robotics and industrial IoT
- blob-storage
- storage-engine
- storage
- historian
High-performance Bayesian Data Analysis on the GPU in Clojure
- clojure
- bayesian-inference
- bayesian-data-analysis
- gpu-computing
CEED Library: Code for Efficient Extensible Discretizations
- ceed
- high-order
- exascale-computing
- api
Clojure library for CUDA development
- clojure-library
- clojure
- cuda-development
- cuda