V100 / SM70-focused vLLM engineering fork for modern LLM inference.
Repository Index
103,113 visible repositories in the index
337–360 of 611 · Most stars
Get clean data from tricky documents, powered by vision-language models ⚡
- multimodal
- large-language-models
- scrapers
Open-source platform for extracting structured data from documents using AI.
Arkon: Enterprise AI Knowledge Hub & MCP Server. Self-hosted knowledge base for teams to manage RAG contexts, access policies, and AI skills. Connect Claude and other LLMs via Model Context Protocol (MCP) for automated, secure organizational knowledge integration.
- enterprise-ai
- knowledge-base-embeddings
- knowledge-based-systems
- knowledge-bases
A RAG LLM co-pilot for browsing the web, powered by local LLMs
OpenOCR: An Open-Source Toolkit for General-OCR Research and Applications, integrates a unified training and evaluation benchmark, commercial-grade OCR and Document Parsing systems, and faithful reproductions of the core implementations from a wide range of academic papers.
- chineseocr
- ocr
- ocr-pytorch
- scene-text-detection
StockBot powered by Groq: Lightning Fast AI Chatbot that Responds With Live Interactive Stock Charts, Financials, News, Screeners, and More. Powered by Llama3-70b on Groq, Vercel AI SDK, and TradingView Widgets.
Local CLI Copilot, powered by Ollama. 💻🦙
Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
- apple-silicon
- deep-learning
- huggingface
- large-language-models
在ChatGPT-Next-Web的基础上,增加注册登录,额度限制,邀请,敏感词,支付,基于docker一键部署。提供后台管理系统,可配置标题、欢迎词、额度不足提醒、公告
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
- decision-models
- jev
- laya
- local-inference
Generate music based on natural language prompts using LLMs running locally
🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.
- ai
- ai-girlfriend
- ai-waifu
- character-ai
Knowledge is a tool for saving, searching, accessing, exploring and chatting with all of your favorite websites, documents and files.
LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
a minimal, distraction-free chat application
- anonymous
- chat
- javascript
- nodejs
tiny AI companions that live on your macOS dock
A Real Time Chat Application built using Node.js, Express, Mongoose, Socket.io, Passport, & Redis.
Chat with your PDFs with AI
Local AI chat + coding agent for Apple Silicon, powered by Gemma 4 via MLX / Supports Ollama
Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment
Fully-featured web interface for Ollama LLMs
The easiest way to use Ollama in .NET