ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
47,133 repositories indexed
1–24 of 48 · Most stars
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
High-performance In-browser LLM Inference Engine
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
- tensorrt
- nvidia
- deep-learning
- inference
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
- inference
- deep-learning
- openvino
- ai
PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.
- mupdf
- xps
- pdf-documents
- epub
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
CUDA Templates and Python DSLs for High-Performance Linear Algebra
- cuda
- deep-learning
- deep-learning-library
- cpp
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
- yolox
- yolov3
- onnx
- tensorrt
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
A collection of libraries to optimise AI model performances
🔮 Libraries & tools for enabling Machine Learning driven user-experiences on the web
- machine-learning
- performance
- web-performance
- prefetch
High-performance TensorFlow library for quantitative finance.
ArrayFire: a general purpose GPU library.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
Java dataframe and visualization library
- dataframe
- data-frame
- java
- java-dataframe
A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:
- opencv
- multithreading
- python
- video-processing
LYGIA, it's a granular and multi-language (GLSL, HLSL, Metal, WGSL, WEGL and CUDA) shader library designed for performance and flexibility