Repository Index

Faster Whisper transcription with CTranslate2

• deep-learning
• inference
• quantization
• speech-recognition

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

• llm
• plm
• pre-trained-language-models
• alpaca

[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant

• funds
• machine-learning
• pytrade
• quantitative-finance

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

• kv-cache
• llm-inference
• local-llm
• quantization

Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

• cuda
• glm
• glm-5
• llm

Dataflow compiler for QNN inference on FPGAs

• dataflow
• quantization
• fpga
• compiler

QKeras: a quantization deep learning library for Tensorflow Keras

• deep-learning
• quantization
• quantized-neural-networks
• hardware-acceleration

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

• tensorflow-2
• tensorflow-lite
• on-device-ml
• model-quantization

PrismQuant: Optimal Null-Space Rotations for Grouped Quantizers

• int4
• large-language-models
• pytorch
• quantization

Legend of Elya — N64 game with a real 6.36M-parameter ternary transformer on the VR4300 MIPS III CPU. Zelda-style dungeon, AI NPCs, byte-level inference at 1.23 tok/s scalar / 2.19 tok/s on the RSP overlay (measured under ares, never on silicon). Built with libdragon.

• ai
• game-dev
• homebrew
• libdragon