SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
55,140 visible repositories in the index
1–24 of 79 · Most stars
ncnn is a high-performance neural network inference framework optimized for the mobile platform
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
High-performance In-browser LLM Inference Engine
- deep-learning
- llm
- tvm
- webgpu
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- gbdt
- gbm
- machine-learning
- data-mining
OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
High-Quality Voice Cloning TTS for 600+ Languages
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- mnn
- convolution
- vulkan
- embedded-devices
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
- java
- gpu
- deeplearning
- neural-nets
High-Resolution Image Synthesis with Latent Diffusion Models
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
- tensorrt
- nvidia
- deep-learning
- inference
PyTorch implementation of the U-Net for image semantic segmentation with high quality images
- pytorch
- unet
- pytorch-unet
- semantic-segmentation
Refine high-quality datasets and visual AI models
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
- yolox
- yolov3
- onnx
- tensorrt
High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)
- wandb
- reinforcement-learning
- pytorch
- python
🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022
- inpainting
- inpainting-methods
- inpainting-algorithm
- computer-vision
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
A Comprehensive Toolkit for High-Quality PDF Content Extraction
Deep learning library featuring a higher-level API for TensorFlow.
- tflearn
- tensorflow
- neural-network
- deep-learning
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
- machine-learning
- decision-trees
- gradient-boosting
- gbm
Pytorch implementation of our method for high-resolution (e.g. 2048x1024) photorealistic video-to-video translation.