Repository Index

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

• llamacpp
• localai
• self-hosted
• gpt

TranslatedProfessional Antigravity Account Manager & Switcher. One-click seamless account switching for Antigravity Tools. Built with Tauri v2 + React (Rust).

• account-manager
• antigravity

A fast, helpful, and open-source document parser

• document-ocr
• document-processing
• ocr
• ocr-recognition

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

• claude
• gemini
• ollama
• openai

A Datacenter Scale Distributed Inference Serving Framework

• diffusion
• disaggregated-serving
• kubernetes
• llm-inference

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

• llama
• llamacpp
• llm-inference
• ollama-api

🛰️ Track token usage across AI coding agents from your terminal. 🏅 Global leaderboard with trillions of tokens tracked.

• claude
• claude-code
• codex
• cursor

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

• ai
• auto-completion
• developer-tools
• ide

Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.

• ai-agent
• desktop-app
• llm
• local-first

Immersive AI-driven Galgame chat with emotional expressions, desktop pet, scheduling, and interactive story modules. / 一款沉浸式 AI-Galgame 聊天软件，附带桌宠，日程，剧情功能

Instant, controllable, local pre-trained AI models in Rust

• ai
• llm
• rust
• llamacpp

AICI: Prompts as (Wasm) Programs

• ai
• rust
• wasm
• wasmtime

Semantic search and document parsing tools for the command line

• cli
• embeddings
• parser
• rust

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

• ai
• llamacpp
• llm
• llmops

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.

• decision-models
• jev
• laya
• local-inference

Native Ubuntu control center for agent usage, system utilities, media, clipboard, emoji and GNOME integration.

• gnome
• linux
• productivity
• rust

🤖 TUI for LLMs

• chatgpt
• llm
• rust
• tui

TavernGym and TavernBench: a faithful, full-content Hearthstone Battlegrounds simulator with an RL interface, and a 960-task decision benchmark. Code and data for "Build, Don't Play".

• game-ai
• hearthstone
• reinforcement-learning
• rust

One API for every LLM: 170+ providers through one client, with a Rust core and native bindings for every major language.

• anthropic
• api-client
• llm
• machine-learning

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

• cuda
• gguf
• inference
• llama-cpp

The repository host gives no description.