Python bindings for llama.cpp
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Concurrency primitives, safe memory reclamation mechanisms and non-blocking (including lock-free) data structures designed to aid in the research, design and implementation of high performance concurrent systems developed in C99+.
Elixir NIFs for interacting with llama_cpp.rust managed GGUF models.