Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Repository Index
47,133 repositories indexed
73–96 of 203 · Most stars
An app that brings language models directly to your phone.
ThinkRail is the agentic IDE that gets better every time you use it
- agent
- agent-skills
- agentic-ai
- agentic-workflow
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing tools, and more to accelerate your development.
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
✨ AI Coding, Vim Style
A pixel desktop pet that watches Claude Code, Codex, Cursor & other AI coding agents — so you don't have to.
- claude-code
- codex
- copilot
- cursor
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
- embeddinggemma
- embeddings
- llama-cpp
- local-first
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
Your Personal Librarian Agent. Ask anything on your computer, organize files, remember important info and files.
- document-parser
- embeddings
- llm
- open-source
Your Friendly Open-Source Gen-AI Platform
- generative
- colaboratory
- colaboratory-notebook
- gan
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
- llm-observability
- agent-monitoring
- agent-observability
- ai-error-monitor
The Ruby AI framework.
TranslatedFull-text PDF translation with layout preserved and bilingual side-by-side display · Search 240 million papers and add them to your library in one click · Q&A over your library knowledge base · AI close reading of papers, literature reviews, and mind maps · Journal quartile / Chinese Academy of Sciences (CAS) ranking / JCR / impact factor shown directly in the list · Plugin-free web version app.ai4paper.pro · Compatible with Zotero 7–10
- academic-writing
- ai-research
- literature-review
- paper-reading
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
- agents
- ai
- decentralized
- distributed
TranslatedWorkBuddy international and domestic multi-account reverse proxy gateway, supporting Codex / Claude Code / DSH and standard OpenAI clients.
- api-gateway
- claude-code
- codebuddy
- codex
An unofficial Visual Studio Code - OpenAI ChatGPT integration
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
- privacy-first
- gguf
- llama-cpp
- local-ai
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)
IoT Platform Framework
- golang
- iot-platform
- edge-computing
- distributed-systems