Fast inference engine for Transformer models
- neural-machine-translation
- cpp
- mkl
- quantization
57,138 visible repositories in the index
25–31 of 31 · Most stars
Fast inference engine for Transformer models
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
Implementing LLM architectures from scratch in PyTorch
An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.
🔥🔥 The extremely fast inference engine for decision model
TranslatedMultimodal retrieval in practice: intent recognition, prompt engineering, Qwen LoRA, EmbeddingGemma 2, and InfoNCE contrastive learning. Includes real demos, integration of your own data, training and evaluation, and a learning guide to RAG retrieval components.
Transform Git history: rewrite, clean, and optimize your repositories with ease.