Calculate the real cost to run your JS app or lib to keep good performance. Show error in pull request if the cost exceeds the limit.
Repository Index
132,183 visible repositories in the index
1–2 of 2 · Most stars
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
- ggml
- huggingface
- llm
- quantization