Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.