Inference module for RangeNet++ (milioto2019iros, chen2019iros)
Repository Index
47,133 repositories indexed
121–144 of 167 · Most stars
Python package facilitating the use of Bayesian Deep Learning methods with Variational Inference for PyTorch
- bayesian-inference
- deep-learning
A fast and efficient type assistant for Python, including tensor shape inference
- python
- typing
Bayesian Generalized Kernel Inference for Terrain Traversability Mapping
This repository provides you with an easy-to-use labeling tool for State-of-the-art Deep Learning training purposes. It supports Auto-Labeling.
- labeling-tool
- label
- tensorflow
- deep-learning
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
- cpu
- diffusion-models
- gguf
- inference
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Our lightning-fast inference engine.
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- isolation-forest
- spark
- outlier-detection
TypeQL: Built for systems, not records
- reasoning
- query-language
- query
- inference
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
A library and microservice implementing the health and care terminology SNOMED CT with support for cross-maps, inference, fast full-text search, autocompletion, compositional grammar and the expression constraint language.
- terminology
- snomed-ct
- snomed
- terminology-server
inference and machine learning in clojure
A collection of awesome papers, articles and various resources on credit and credit risk modeling
- credit-scoring
- credit-modeling
- financial-machine-learning
- sample-selection
Streaming-first load balancer for AI inference gateways
Translated🐋 Complete guide in Russian: how to install and run DeepSeek locally (V4, R1) on PC, Mac and server — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, agents, fine-tuning, best tips and tricks
- ai-agents
- deepseek
- deepseek-r1
- deepseek-v4
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
- tensorflow-2
- tensorflow-lite
- on-device-ml
- model-quantization
Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.
- time-series-analysis
- model-selection
- bayesian-inference
- anomaly-detection
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Feel how fast a local LLM runs before you buy the hardware
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
llama.cpp fork that abliterates at inference