Sign in

Repository Index

47,133 repositories indexed

Tag: LLM tools
Tag
Filters (1)

Filters

Clear all filters

1–6 of 6 · Most stars

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

  • calibration
  • cuda
  • cuda-graphs
  • decision-making