Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
132,241 visible repositories in the index
1–3 of 3 · Most stars
Hundreds of models & providers. One command to find what runs on your hardware.
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
Benchmarks for rust serialization frameworks