[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Repository Index
85,081 visible repositories in the index
145–168 of 777 · Most stars
Point at any URL/YouTube/Podcast or file. Get the gist. CLI and Chrome Extension.
One UI is all done with chatgpt web, midjourney, gpts,suno,luma,runway,viggle,flux,ideogram,realtime,pika,udio; Simultaneous support Web / PWA / Linux / Win / MacOS platform
- chatgpt-ui
- midjourney-ui
- gpts
- suno
A lightweight LMM-based Document Parsing Model
🚀🧠💬 Supercharged Custom Instructions for ChatGPT (non-coding) and ChatGPT Advanced Data Analysis (coding).
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
- apple-intelligence
- apple-silicon
- cli
- foundationmodels
Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.
Self-hosted control plane for AI agents: dispatch tasks, review runs, track spend, and operate OpenClaw, Claude Code, Codex, and other runtimes.
Translated🌻 One click access to your own ChatGPT+Many AI web services
An open, programmable decision layer for models and compute.
- mixture-of-models
- semantic-router
- vllm
- ai-gateway
Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 50 other agents.
🐬DeepChat - A smart assistant that connects powerful AI to your personal world
- ai-assistant
- cross-platform
- llm-client
- openai-client
AI coding assistant for Xcode
- intelligence
- xcode
- ai-assistant
- github-copilot
The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.
- adk
- agent-development-kit
- agents
- coding-agent
Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retrieval metrics.
- metric-learning
- deep-learning
- computer-vision
- machine-learning
TranslatedBibiGPT v1 · one-Click AI Summary for Audio/Video & Chat with Learning Content: Bilibili | YouTube | Tweet丨TikTok丨Dropbox丨Google Drive丨Local files | Websites丨Podcasts | Meetings | Lectures, etc. Also: 小红书 (Xiaohongshu, "Little Red Book")丨抖音 (Douyin)丨快手 (Kuaishou, "fast hand")丨百度网盘 (Baidu Netdisk)丨阿里云盘 (Aliyun Drive) (formerly BiliGPT 省流神器 (Shengliu Shenqi, "data-saving magic tool") & AI课代表 (AI Kedaibiao, "AI class representative"))
A curated set of 200+ plug-and-play n8n workflows that fuse classic automation with today’s AI stack—vector DBs, embeddings, and LLMs. Import any JSON, add your creds, hit Activate, and you’re live. Built to demo, prototype, or drop straight into production.
- automation
- automation-templates
- integration
- n8n
🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
- chinese
- computer-vision
- multi-modal-learning
- nlp
An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.
- ai
- automation
- paperless
- paperless-ngx
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
🐢 Open-Source Evaluation & Testing library for LLM Agents
- mlops
- ml-validation
- ml-testing
- ai-testing
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
- llm
- llm-reasoning
- machine-learning-systems
- mlsys