Sign in

Repository Index

70,234 visible repositories in the index

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

217–240 of 259 · Most stars

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.

  • abliterated-models
  • ai-gateway
  • anthropic-compatible
  • claude-api

Translateddsh jailbreak - DeepSeek Assistant jailbreak plugin (DSH jailbreak / jailbreak / jailbreak prompts): request boundary injection, so the model no longer starts with "I can't" right away. Combined ASR across 20 categories 45.0%, coverage 19/20, benign capability Δ=0.0pt (24/24 graded); 0 host patches, off by default, off passes through verbatim, every rewrite is recorded in a manifest and promptSha256 for auditing. Former name dsh-jalibreak

Enterprise-grade benchmark evaluating whether AI agents deliver verifiable business outcomes in real business systems — general domain, finance, supply chain, and manufacturing.

  • mfg
  • scm
  • erp
  • eval

One command downloads a complete offline, no-internet emergency library: local AI (CPU/GPU), document Q&A, full Wikipedia, offline maps for any country/region (default US), survival/repair/medical archives, and public-domain manuals. Asks only where to save.

TranslatedPhone-like KOReader home: curated AI news, AI translation and Q&A on selections, WeRead shortcut

  • ebook-reader
  • kindle
  • koreader
  • lua

PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.

DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.

  • benchmark
  • calibration
  • decision-making
  • evaluation

DeepSeek Harness Desktop 插件,让 AI Agent 用自然语言构建、检查和维护可编辑的 SideFX Houdini 工程,支持程序化建模、HDA、场景诊断与渲染。 | A DeepSeek Harness Desktop plugin that lets AI agents build, inspect, and maintain editable SideFX Houdini projects with natural language, including procedural modeling, HDAs, scene diagnostics, and rendering.