Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
- ggml
- huggingface
- llm
- quantization
132,241 visible repositories in the index
1–1 of 1 · Most stars
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization