Sign in

Repository Index

111,821 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters (1)

Filters

Clear all filters

217–240 of 315 · Most stars

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

Neural Network Compression Framework for enhanced OpenVINO™ inference

  • quantization
  • pruning
  • sparsity
  • quantization-aware-training

A Python package for causal inference in quasi-experimental settings

  • causal-inference
  • pymc
  • quasi-experimental
  • quasi-experiments

⚡VoltaML is a lightweight library to convert and run your ML/DL deep learning models in high performance inference runtimes like TensorRT, TorchScript, ONNX and TVM.

EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.

BlackJAX is a Bayesian Inference library designed for ease of use, speed and modularity.

  • probabilistic-programming
  • bayesian-inference
  • sampling-methods
  • hamiltonian-monte-carlo