Chat Chat, your own unified chat and search to AI platform, with a simple and easy to use interface.
Repository Index
55,140 visible repositories in the index
73–96 of 112 · Most stars
Simple shell script to use OpenAI's ChatGPT and DALL-E from the terminal. No Python or JS required.
- chatbot
- chatgpt
- chatgpt-api
- chatgpt-api-wrapper
Complete logs of the experiments in the blog post 'LLMs can understand and write neural network weights'
A lightweight knowledge base for people and agents, with ultra fast indexing and most precise retrieval.
- knowledge-base
- knowledge-graph
- rag
- rust
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
- anthropic-api
- cuda
- gemma
- gguf
🐋 Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). SwiGLU-H2, Stockfish-PVS L3 & 13ms Claude Code restore.
This repo offers a simple interface that helps you to read&summerize research papers in pdf format. You can ask some questions after reading. This interface is developed based on openai API and using GPT-3.5-turbo model.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
- apple-silicon
- clover
- coding-agents
- decision-models
Real-time observability of claude code sessions & multi-agents.
A simple deep learning library for estimating a set of tags and extracting semantic feature vectors from given illustrations.
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
- apple-silicon
- llm
- llm-inference
- local-llm
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
A Java library to use the OpenAI Api in the simplest possible way.
- httpclient
- java
- openai
- simple
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Neovim edit completion plugin
- nvim
- cursor-prediction
- edit-completion
TranslatedA relay API jailbreak project written in Rust, supporting the Responses / Chat Completions / Anthropic Messages APIs, and supporting most mainstream models such as ChatGPT/Claude/Grok/Gemini/Deepseek/Glm/Kimi
Deepinfer inspired implemetation on SM80 Ampere architecture. Deepest respect for DeepSeek opensource this work!
M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + React + mlx-lm.
- ai-assistant
- apple-silicon
- desktop-app
- fine-tuning
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
One command downloads a complete offline, no-internet emergency library: local AI (CPU/GPU), document Q&A, full Wikipedia, offline maps for any country/region (default US), survival/repair/medical archives, and public-domain manuals. Asks only where to save.
- claude
- claude-code
- emergency-preparedness
- kiwix
Official implementation of paper "Cache Engineering for Agents"
Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.
Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
- ane
- apple
- apple-neural-engine
- neural-engine
TranslatedPhone-like KOReader home: curated AI news, AI translation and Q&A on selections, WeRead shortcut
- ebook-reader
- kindle
- koreader
- lua