Build, train, optimize, and run computer vision models locally, from raw images to live inference. Open source, optimized for Intel® XPU (CUDA also supported).
- openvino
- computer-vision
- deep-learning
- pytorch
132,241 visible repositories in the index
169–192 of 324 · Most stars
Build, train, optimize, and run computer vision models locally, from raw images to live inference. Open source, optimized for Intel® XPU (CUDA also supported).
The Medical Detection Toolkit contains 2D + 3D implementations of prevalent object detectors such as Mask R-CNN, Retina Net, Retina U-Net, as well as a training and inference framework focused on dealing with medical images.
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
Deploy a ML inference service on a budget in less than 10 lines of code.
OpenTelemetry Instrumentation for AI Observability
A batched offline inference oriented version of segment-anything
Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows
BAyesian Model-Building Interface (Bambi) in Python.
A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.
https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
The challenge projects for Inferencing machine learning models on iOS
wireless hacking - This is automated wireless hacking tool
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
LLM KV cache compression made easy
Official inference code for SoulX-LiveAct: Towards Hour-Scale Real-Time Human Animation with Neighbor Forcing and ConvKV Memory
Pytorch-Named-Entity-Recognition-with-BERT
Added vLLM support to IndexTTS for faster inference.
Package for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
The simplest way to serve AI/ML models in production
https://wavespeed.ai/ [WIP] The all in one inference optimization solution for ComfyUI, universal, flexible, and fast.
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.