Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
84,583 visible repositories in the index
49–72 of 761 · Most stars
Distribute and run LLMs with a single file.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
A curated collection of fun and creative examples generated with Nano Banana & Nano Banana Pro🍌, Gemini-2.5-flash-image based model. We also release Nano-consistent-150K openly to support the community's development of image generation and unified models(click to website to see our blog)
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
OpenUI let's you describe UI using your imagination, then see it rendered live.
Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
TranslatedEnhancement suite for Gemini, AI Studio, Claude, ChatGPT & DeepSeek — plus a prompt manager for any website, DeepSeek Harness included.
TranslatedProduction-grade platform for building agentic IM bots - Agent, knowledge base orchestration, plugin system / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信 (Qiye Weixin, "Enterprise WeChat"), 企微智能机器人 (Qiwei Zhineng Jiqiren, "Enterprise WeChat smart bot"), 公众号 (Gongzhonghao, "official account")) / 飞书 (Feishu, "flying book") / 钉钉 (Dingding, "nail nail") / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
Build a portrait of your life. Assistants that know you better. Clones that sound more like you.
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
Use your Neovim like using Cursor AI IDE!
The Cloud-Native API Gateway and AI Gateway
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.
Topic Modelling for Humans
Simple, unified interface to multiple Generative AI providers