Repository Index

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

• apple-silicon
• cuda
• gguf
• inference

OpenAI (and DeepSeek, Azure OpenAI, YandexGPT, Ollama, GigaChat, Qwen) API wrapper for Delphi. Use ChatGPT, DALL-E, Whisper and other products.

• api-wrapper
• delphi
• gpt
• gpt-3

Fast fork of llama.cpp designed for Qwen3.8-Flash-Next

Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.

• gpt
• openai
• context
• embedding

A ChatGPT, Gemini, Claude, and Ollama(offline) plug-in for Embarcadero RAD Studio IDE XE5 to 12.1

• chatgpt
• chatgpt-api
• delphi
• embarcadero

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

• ai
• gguf
• gpu
• inference

TranslatedBig Blue Fish desktop pet with local LLM. A Windows AI desktop pet with a built-in 4B local large model. It uses a whale-girl persona that combines weather, tech news and the current application to keep you gentle company through text bubbles. Supports one-click installation and pausing inference when off power.

• ai-companion
• deepseek
• desktop-companion
• desktop-pet

M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + React + mlx-lm.

• ai-assistant
• apple-silicon
• desktop-app
• fine-tuning

llama.cpp fork that abliterates at inference

• abliteration
• ai
• inference
• llama-cpp

ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.

• abliteration
• hermes
• inference
• llama-cpp

Integrate ChatGPT-style LLMs into Neovim: ask questions, keep multi-file context, pull diagnostics / command output, and chat without leaving your editor. Highly configurable, async, lua-only plugin.

• neovim
• neovim-plugin
• nvim
• nvim-lua

Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

• agent-evaluation
• ai-agents
• fastapi
• ollama

Manage and use multiple Ollama instances with automatic offline detection/failover and model availability tracking

Shell wrapper for OpenAI's ChatGPT, Whisper, and TTS. Features LocalAI, Ollama, Gemini, Anthropic, and more.

• awesome-chatgpt-prompts
• bash
• terminal
• chat-completions

PDF extraction that audits its own output — and certifies any other extractor's, catching pages they silently dropped. Verify signed manifests offline: free, MIT, no account. 0.903 on opendataloader-bench, #2 of 8 engines. 7-tool MCP server.

• llm
• mcp
• ocr
• pdf

GPTModels - a multi model, window based LLM AI plugin for neovim, with an emphasis on stability and clean code

• ai
• llm
• neovim
• plugin

Inference Llama in Common Lisp

A powerful and easy-to-use PHP SDK for the Mistral AI API, allowing seamless integration of advanced AI-powered features into your PHP projects.

• ai
• api
• api-client
• api-wrapper

Prompt-injection firewall for LLM applications — 33 input detectors, 9 output scanners, federated ed25519-signed threat-intel feed. Apache 2.0, 1040 tests, F1 96.0% with 0% false positives. Docker, GitHub Action, LangChain/LlamaIndex/CrewAI integrations.

• agentic-ai
• ai-safety
• fastapi
• langchain

Effortless Natural Language Generation: Ollama, Anthropic (Calude), ChatGTP

• chatgpt
• claude
• llm
• neovim

Minimalist command based AI plugin to interact with LLM backends like Ollama and OpenAI with a powerful template system

• ai
• command-line
• llm
• lua