Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
- gemma
- gpgpu
- llm
- local-ai
Repository Index
57,138 visible repositories in the index
241–264 of 668 · Most stars
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
- chatbot
- gpt
- large-language-model
- long-context
DeepSeek LLM: Let there be answers
Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings
TranslatedSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage.
AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- gateway
- generative-ai
- llm-inference
- llms
lightweight, standalone C++ inference engine for Google's Gemma models.
Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Translateddsh-purge Community · Community-maintained edition of DeepSeek Harness: host compatibility, status diagnostics, prompt management, updates, and local backup and rollback. Based on dsh-purge by 小杨 (Xiao Yang) / YuJunZhiXue.
- agent-tools
- backup
- deepseek
- deepseek-harness
An APP that integrates mainstream large language models and image generation models, built with Flutter, with fully open-source code.
Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
- localllm
Postgres with GPUs for ML/AI apps.
- ml
- machine-learning
- ai
- ann
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Native web workspace for Hermes Agent — chat, terminal, memory, skills, inspector.
- agent-ui
- ai-workspace
- hackathon
- hermes-agent
One UI is all done with chatgpt web, midjourney, gpts,suno,luma,runway,viggle,flux,ideogram,realtime,pika,udio; Simultaneous support Web / PWA / Linux / Win / MacOS platform
- chatgpt-ui
- midjourney-ui
- gpts
- suno
Modeling, training, eval, and inference code for OLMo
TranslatedFirefly: a large model training tool that supports training large models such as Qwen2.5, Qwen2, Yi1.5, Phi-3, Llama3, Gemma, MiniCPM, Yi, Deepseek, Orion, Xverse, Mixtral-8x7B, Zephyr, Mistral, Baichuan2, Llma2, Llama, Qwen, Baichuan, ChatGLM2, InternLM, Ziya2, Vicuna, Bloom, etc.
Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
- apple-intelligence
- apple-silicon
- cli
- foundationmodels
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"