PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
Repository Index
132,241 visible repositories in the index
1–7 of 7 · Most stars
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
- libtorch
- yolov5
- inference
- torchscript
Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.
- c99
- catboost
- compiler
- decision-trees
A fast and efficient type assistant for Python, including tensor shape inference
- python
- typing
Open source compiler for your whole ML repo (support python, CUDA C/C++) into sass and cuda binary (which are closed sourced by Nvidia); 3-40% faster than Openai Triton for Neural Network (primarily LLM) based training/inferencing
- compiler
- compiler-backend
- compiler-optimization
- gpu-acceleration
A CLI tool to automatically add type annotations into Python code. Must have tool for annotating existing code.
- code-formatter
- code-generation
- mypy
- pyannotate
Opinionated typing package for precise type hints in Python
- pep484
- python
- python-typing
- numpy