Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
132,241 visible repositories in the index
1–7 of 7 · Most stars
Hundreds of models & providers. One command to find what runs on your hardware.
Performance monitoring and benchmarking suite
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
Classifies GPUs based on their 3D rendering benchmark score allowing the developer to provide sensible default settings for graphically intensive applications.
Benchmarking Deep Learning operations on different hardware
Feel how fast a local LLM runs before you buy the hardware
Create, Read, Update and Delete benchmarks at crude hardware speeds for embedded engines and database servers, the Rust successor to UCSB & YCSB