For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
Repository Index
111,820 visible repositories in the index
1–1 of 1 · Most stars
111,820 visible repositories in the index
1–1 of 1 · Most stars
For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp