Sign in

Repository Index

132,241 visible repositories in the index

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

49–64 of 64 · Most stars

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

Open-source, self-hosted AI agent platform for your company's AI teammates. Build, run and govern agents on your own servers and models: shared chat, RAG, skills, a real browser, 4,700+ MCP servers, budgets, approvals and an audit trail. An alternative to ChatGPT Enterprise and Grok Bot. Apache-2.0, built on Pydantic AI.

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.

SUGT - local AI gateway & skills console. Centralize LLM API keys, one OpenAI/Anthropic-compatible proxy for Claude Code, Codex & OpenCode. Homebrew & winget. Fully open source (Apache-2.0).

TranslatedA mobile web app where the hamster Mugi (むぎ) practices Japanese conversation with you one-on-one. Core idea: the LLM outputs structured replies using a JSON Schema, with the Japanese lines and the Chinese tips in separate fields, and the frontend uses partial JSON parsing to display the reply as it streams in; prompt caching and voice caching are maintained even during long chats. Kanji readings are annotated by the LLM, and any that it misses are filled in by kuromoji on the server side. Corrections are automatically saved into a tips notebook, so you can practice speaking until you have mastered them. For voice, you can choose local VOICEVOX or cloud Google/Azure, and the keys stay only on the local server. Developed in collaboration with Claude Code (Opus 5.5); originally for personal use, it was released as open source with a brand-new git history that contains no personal data or third-party assets. Records of each decision are in docs/decisions/.

Prompt-injection firewall for LLM applications — 33 input detectors, 9 output scanners, federated ed25519-signed threat-intel feed. Apache 2.0, 1040 tests, F1 96.0% with 0% false positives. Docker, GitHub Action, LangChain/LlamaIndex/CrewAI integrations.