Sub-50mb agentic, voice and vision intelligence for consumer devices.
- cactus
- llm
- on-device-ai
- edge-ai
Repository Index
65,264 visible repositories in the index
121–144 of 641 · Most stars
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
Desktop Companion for Hermes Agent
A framework for few-shot evaluation of language models.
- evaluation-framework
- language-model
- transformer
structured outputs for llms
- openai
- python
- pydantic-v2
- openai-functions
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
TranslatedChatGLM3 series: Open Bilingual Chat LLMs
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
- huggingface
- java
- langchain
- openai
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- gateway
- generative-ai
- llmops
- llms
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Capture first. Organize later. A local-first Markdown app that turns scattered records into clear notes with AI.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
The simplest way to run LLaMA on your local machine
Access large language models from the command-line
Go ahead and axolotl questions
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/