the LLM vulnerability scanner
- ai
- llm-evaluation
- llm-security
- security-scanners
58,136 visible repositories in the index
289–312 of 1,101 · Most stars
the LLM vulnerability scanner
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
High-speed Large Language Model Serving for Local Deployment
LangChain for Go, the easiest way to write LLM-based programs in Go
🤖 AI Gateway | AI Native API Gateway
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
An Application Framework for AI Engineering
High accuracy RAG for answering questions from scientific documents with citations
The fast, precise document-intelligence engine for every language: text, tables and metadata from 100+ formats, with OCR, transcription and code intelligence.
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
Lightweight (7MB) terminal-first AI-native development environment
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Source control for agents. Use multiple coding agents, track their changes and query them in one place
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
An AI-powered search engine with a generative UI
❯ Lightweight, beautiful and user-friendly interactive prompts
An app that brings language models directly to your phone.
Curated prompts, frameworks and papers for LLMs and agents, with an engineering bias. Prompt engineering, context engineering, agent harnesses, red teaming.
KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
ImageBind One Embedding Space to Bind Them All