Sign in

Repository Index

55,140 visible repositories in the index

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–6 of 6 · Most stars

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

TranslatedA relay API jailbreak project written in Rust, supporting the Responses / Chat Completions / Anthropic Messages APIs, and supporting most mainstream models such as ChatGPT/Claude/Grok/Gemini/Deepseek/Glm/Kimi

Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — just you and your personal AI assistant