Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
47,133 repositories indexed
1–2 of 2 · Most stars
Distribute and run LLMs with a single file.
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.