Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- llm
- text-embeddings
- bert-embeddings
132,241 visible repositories in the index
289–312 of 1,100 · Most stars
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
TokenSpeed is a speed-of-light LLM inference engine.
VirtualWife是一个虚拟数字人项目,支持B站直播,支持openai、ollama
Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
Unleash Next-Level AI! 🚀 💻 Code Generation: DeepSeek r1 + Claude 3.7 Sonnet - Unparalleled Performance! 📝 Content Creation: DeepSeek r1 + Gemini 2.5 Pro - Superior Quality! 🔌 OpenAI-Compatible. 🌊 Streaming & Non-Streaming Support. ✨ Experience the Future of AI – Today! Click to Try Now! ✨
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
Reference implementation for DPO (Direct Preference Optimization)
Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目,支持在 Mac mini/MacBook 上或通过算力棒本地运行推理,实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理,支持复杂多步骤任务规划与执行。
Your Neovim AI sidekick
中文langchain项目|小必应,Q.Talk,强聊,QiangTalk
The Open Source Alternative to Cluely - A lightning-fast, privacy-first AI assistant that works seamlessly during meetings, interviews, and conversations without anyone knowing. Built with Tauri for native performance, just 10MB. Completely undetectable in video calls, screen shares, and recordings.
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
TranslatedPagekin (formerly AI Novel Writer): free, open-source AI novel writing app for long novels and web fiction. Imitate, continue, rewrite; import writing skills. Local-first, no model bundled. Windows & macOS. Pagekin, a free AI novel writing app, covers everything from settings and blueprints to the main text, review, and final draft. It supports deconstructing and imitating, continuing, and rewriting, and can import writing Skills (such as removing the "AI flavor"). You must configure the model yourself; your works stay local.
Professional AI research tool for Zotero: chat with PDFs, whole-library search, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server. Chat with your pocket Zotero on iPhone → https://www.docsagent.app
The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.
TranslatedUnified research workspace for humans & agents — PDF Q&A with citations, Vault, writing. A research workspace for collaboration between humans and agents; fills the human-machine context gap of the Zotero era.
A beautiful, minimal meeting recorder for Mac. Press Start, and after Stop you get Notes and a transcript in one markdown file. On-device, free and open source.
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
A Toolkit for Industrial Topic Modeling
A benchmark for LLMs on complicated tasks in the terminal