Sign in

Repository Index

108,094 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters (1)

Filters

Clear all filters

433–456 of 687 · Most stars

Python library for arbitrary-precision floating-point arithmetic

  • python
  • arbitrary-precision
  • multiprecision
  • floating-point

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

Neural Network Compression Framework for enhanced OpenVINO™ inference

  • quantization
  • pruning
  • sparsity
  • quantization-aware-training

A Python package for causal inference in quasi-experimental settings

  • causal-inference
  • pymc
  • quasi-experimental
  • quasi-experiments

Emerge is a browser-based interactive codebase and dependency visualization tool for many different programming languages. It supports some basic code quality and graph metrics and provides a simple and intuitive way to explore and analyze a codebase by using graph structures.

  • visualization
  • graph-visualization
  • dependency-graph
  • source-code-analysis

⚡VoltaML is a lightweight library to convert and run your ML/DL deep learning models in high performance inference runtimes like TensorRT, TorchScript, ONNX and TVM.