General code to convert a trained keras model into an inference tensorflow model
Repository Index
132,241 visible repositories in the index
337–360 of 748 · Most stars
Awesome resources on normalizing flows.
- normalizing-flows
- bayesian-neural-networks
- variational-inference
- density-estimation
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
MixTeX multimodal LaTeX, ZhEn, and, Table OCR. It performs efficient CPU-based inference in a local offline on Windows.
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- deepseek
- inference
- inference-engine
- llm-inference
This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"
- nlp
- python
- machine-learning
Infer.NET is a framework for running Bayesian inference in graphical models
- machine-learning
- bayesian-inference
Import .sql files into TypeScript with full type inference and zero codegen.
Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.
- homelab
- local-ai
- ai-workstation
- gpu-server
Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
- prometheus
- prometheus-exporter
- nvidia-gpu
- nvidia
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
- deep-learning
- language-model
- llm
- machine-learning
Bayesian Convolutional Neural Network with Variational Inference based on Bayes by Backprop in PyTorch.
- convolutional-neural-networks
- bayesian-network
- bayesian-convnets
- bayes-by-backprop
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
- nlp
- transformer
- bert
- decoder
Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
- jax
- llm-inference
- llms
- roofline
List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
- ai
- ai-search-engine
- artificial-intelligence
- artificial-intelligence-projects
Extensions giving Swift's Codable API type inference super powers 🦸♂️🦹♀️
- swift
- codable
- json-parsing
- type-inference
Local inference engine optimized for NVIDIA Blackwell
Generate Nix packages from URLs with hash prefetching, dependency inference, license detection, and more [maintainer=@figsoda]
- go
- nix
- rust
- cargo
React’s programming model, compiled. The successor to Inferno.
Yolov5 deepsort inference,使用YOLOv5+Deepsort实现车辆行人追踪和计数,代码封装成一个Detector类,更容易嵌入到自己的项目中
- yolov5-deepsort-inference
- yolov5
- deepsort
- object-detection
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
- pytorch
- acceleration
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
- decision-models
- jev
- laya
- local-inference