ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
47,133 repositories indexed
1–24 of 51 · Most stars
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
High-performance In-browser LLM Inference Engine
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" means "better RPC".
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
- computer-vision
- deep-learning
- drug-discovery
- forecasting
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Open Machine Learning Compiler Framework
- compiler
- tensor
- deep-learning
- gpu
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
- tensorrt
- nvidia
- deep-learning
- inference
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
- inference
- deep-learning
- openvino
- ai
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
CUDA Templates and Python DSLs for High-Performance Linear Algebra
- cuda
- deep-learning
- deep-learning-library
- cpp
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
- yolox
- yolov3
- onnx
- tensorrt
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
A collection of libraries to optimise AI model performances
🔮 Libraries & tools for enabling Machine Learning driven user-experiences on the web
- machine-learning
- performance
- web-performance
- prefetch
High-performance TensorFlow library for quantitative finance.
ArrayFire: a general purpose GPU library.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp