Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
- anthropic-api
- cuda
- gemma
- gguf
A voice chat app
GVS5H: Five Qwen3.8-27B Models Match Claude Fable 5 on LiveCodeBench Hard | Fable 5 Level Coding for a Fifth the Price - or on a Single GPU
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
Open-source antivirus and firewall for AI agents: block risky tools, secret access, prompt injection, malicious packages, MCP servers, plugins, and skills at runtime.
LLM-based ontological extraction tools, including SPIRES
Benchmarking Generalized Out-of-Distribution Detection
- out-of-distribution-detection
- anomaly-detection
- open-set-recognition
- novelty-detection
A security scanner for your LLM agentic workflows
A fast llama2 decoder in pure Rust.
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Autonomous Offensive Security, Bug Bounty & Red Teaming Agent Framework powered by Hermes Agent, specialized reasoning skills, and multi-model LLM orchestration.
A lightweight inference engine supporting speculative speculative decoding (SSD).
Claude Code. Any Model. The most powerful AI coding agent now speaks every language.
OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
A privacy-first guardrail for LLMs and RAG pipelines. SurrogateShield detects, redacts, and reconstructs sensitive PII data on the fly while defending against adversarial attacks.
An Open Foundation Model and Benchmark to Accelerate Generative Recommendation
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
Deploy a Gemini multimodal chat website in 10 seconds, Severless! 只需准备一个Gemini API Key,10秒即可部署一个Gemini多模态对话的网站。
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
毒奶博主的自用机场推荐——150GB/14元/月起,Vless/AnyTLS协议支持,透传,IEPL专线加持,稳定低延迟,ChatGPT 等AI工具支持,Netflix等主流流媒体区域限制解锁;