Sub-50mb agentic, voice and vision intelligence for consumer devices.
- cactus
- llm
- on-device-ai
- edge-ai
47,133 repositories indexed
145–168 of 518 · Most stars
Sub-50mb agentic, voice and vision intelligence for consumer devices.
A framework for few-shot evaluation of language models.
A very simple framework for state-of-the-art Natural Language Processing (NLP)
structured outputs for llms
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
🍌 World's largest Nano Banana Pro prompt library — 10,000+ curated prompts with preview images, 16 languages. Google Gemini AI image generation. Free & open source.
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
All parts of Claude Code's system prompt, 27 builtin tool descriptions, sub agent prompts (Plan/Explore/Task), utility prompts (CLAUDE.md, compact, statusline, magic docs, WebFetch, Bash cmd, security review, agent creation). Updated for each Claude Code version.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
TranslatedCRS - a self-hosted Claude Code mirror, a one-stop open-source relay service that lets Claude, OpenAI, Gemini, and Droid subscriptions be accessed in a unified way. It supports carpool-style shared use to split costs more efficiently, and native tools work seamlessly.
TranslatedLangGPT: Empowering everyone to become a prompt expert! 🚀 📌 Proposer of Structured Prompt 📌 Initiator of Meta-Prompt 📌 The most popular paradigm for putting prompts into practice | Language of GPT The pioneering framework for structured & meta-prompt design 10,000+ ⭐ | Battle-tested by thousands of users worldwide Created by 云中江树 (Yunzhong Jiangshu, "river and trees amid the clouds")
TranslatedA toolbox of film styles made in code for Claude Code: 66 ready to use, and your own. Each style is a style prompt plus a demo film made entirely in code by Claude Opus 5.5, with no video model. By Lemomo.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
An open-source, tool-augmented conversational language model from Fudan University
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
Retrieval and Retrieval-augmented LLMs
OCR & Document Extraction using vision models
Translated100+ Chinese Word Vectors
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
AI Observability & Evaluation
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.