A throughput-oriented high-performance serving framework for LLMs
Repository Index
132,241 visible repositories in the index
481–504 of 748 · Most stars
Awesome Machine Unlearning (A Survey of Machine Unlearning)
- continual-learning
- data-deletion
- data-privacy
- data-removal
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
- cpu
- cpu-inference
- deep-learning
- faiss
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
Code for paper " AdderNet: Do We Really Need Multiplications in Deep Learning?"
- pytorch
- imagenet
- convolutional-neural-networks
- cvpr2020
List of awesome hosting sorted by minimal plan price
- nodejs
- hosting
- vps
- free
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory
- c
- codegenerator
- cpp
- deep-learning
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
- speculative-decoding
Causal Inference for the Brave and True的中文翻译版。全部代码基于Python,适用于计量经济学、量化社会学、策略评估等领域。英文版原作者:Matheus Facure
- causal-inference
- econometrics
- policy-evaluation
- socialscience
Solve and estimate Dynamic Stochastic General Equilibrium models (including the New York Fed DSGE)
- economics
- macroeconomics
- dsge
- bayesian-inference
Official inference library for pre-processing of Mistral models
PyTorch implementation of normalizing flow models
- normalizing-flow
- variational-autoencoder
- variational-inference
- real-nvp
A scalable inference server for models optimized with OpenVINO™
An open-source framework for verifiably private AI inference
Perplexity open source garden for inference technology
📚 Introduction to Modern Statistics - A college-level open-source textbook with a modern approach highlighting multivariable relationships and simulation-based inference.
- openintro
- statistics
- simulation
- rstats
A CLI to estimate inference memory requirements for Hugging Face models, written in Python.
- huggingface
- safetensors
- gguf
- hf-extension
Bolt is a deep learning library with high performance and heterogeneous flexibility.
- bolt
- inference
- high-performance
- x86
CausalVLR: A Toolbox and Benchmark for Vision-Language Causal Reasoning (多模态因果推理开源框架)
- causal
- causal-inference
- visual-linguistic
- multimodal
The Triton TensorRT-LLM Backend
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
A uniform interface to run deep learning models from multiple frameworks
Code for modelling estimated deaths and cases for COVID19.
- covid-19
- bayesian-statistics
- renewal-process
- branching-process
Real-time multi-person action recognition from OpenPose skeleton sequences, with tracking, feature extraction, model training, and inference pipelines for research and prototyping.
- action-recognition
- openpose
- machine-learning
- time-series