ncnn is a high-performance neural network inference framework optimized for the mobile platform
Repository Index
47,133 repositories indexed
1–24 of 41 · Most stars
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
High-performance In-browser LLM Inference Engine
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
- tensorrt
- nvidia
- deep-learning
- inference
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
- inference
- deep-learning
- openvino
- ai
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
- yolox
- yolov3
- onnx
- tensorrt
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
Java dataframe and visualization library
- dataframe
- data-frame
- java
- java-dataframe
A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:
- opencv
- multithreading
- python
- video-processing
LYGIA, it's a granular and multi-language (GLSL, HLSL, Metal, WGSL, WEGL and CUDA) shader library designed for performance and flexibility
Multi-language suite for high-performance solvers of differential equations and scientific machine learning (SciML) components. Ordinary differential equations (ODEs), stochastic differential equations (SDEs), delay differential equations (DDEs), differential-algebraic equations (DAEs), and more in Julia.
- differential-equations
- differentialequations
- julia
- ode
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.
TranslatedHigh-performance · Lightweight · AI Native Video workspace. A video creation workspace for the AI era. On the canvas, freely connect ideas and materials together with the Agent.
- ai-image-generation
- ai-video
- ai-video-generation
- ai-workspace
ILGPU JIT Compiler for high-performance .Net GPU programs
⛓️RuleGo is a lightweight, high-performance, embedded, next-generation component orchestration rule engine framework for Go.
- go
- rule-engine
- edge-computing
- iot
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
- reinforcement-learning
- parallel-processing
- cpp17
- pybind11
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream