Sign in

Repository Index

132,241 visible repositories in the index

Tags: LLM tools
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–19 of 19 · Most stars

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

CORTEX RAG is an enterprise retrieval and knowledge assistant that helps teams find accurate answers from company data with citations, permission-aware retrieval, and fast deployment

Official implementation for "Towards a Unified Self-Distillation Framework for Large Language Models" (https://arxiv.org/abs/2605.06597).

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.

TranslatedA mobile web app where the hamster Mugi (むぎ) practices Japanese conversation with you one-on-one. Core idea: the LLM outputs structured replies using a JSON Schema, with the Japanese lines and the Chinese tips in separate fields, and the frontend uses partial JSON parsing to display the reply as it streams in; prompt caching and voice caching are maintained even during long chats. Kanji readings are annotated by the LLM, and any that it misses are filled in by kuromoji on the server side. Corrections are automatically saved into a tips notebook, so you can practice speaking until you have mastered them. For voice, you can choose local VOICEVOX or cloud Google/Azure, and the keys stay only on the local server. Developed in collaboration with Claude Code (Opus 5.5); originally for personal use, it was released as open source with a brand-new git history that contains no personal data or third-party assets. Records of each decision are in docs/decisions/.