Repository Index

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

• llama
• llamacpp
• llm-inference
• ollama-api

A blazing fast inference solution for text embeddings models

• ai
• embeddings
• huggingface
• llm