A fast inference library for running LLMs locally on modern consumer-class GPUs
Repository Index
71,865 visible repositories in the index
313–336 of 826 · Most stars
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
- chatgpt
- chatgpt-api
- gpt-3
- gpt-3-prompts
CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.
- compliance
- grc
- soc2
- gdpr
🤗 AutoTrain Advanced
Semantic search over videos using Gemini Embedding 2 or Qwen3-VL.
- chromadb
- dashcam
- gemini
- gemini-embedding-2
A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.
- agent-memory
- agentic-ai
- ai-reasoning
- episodic-memory
The Ruby AI framework.
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
- agi
- evaluation
- large-language-models
- multimodal
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
- gpt-4v
- large-language-models
- llava
- multi-modal
Set of tools to assess and improve LLM security.
Costrict - strict AI coder for enterprises, quality first, including AI Agent, AI CodeReview, AI Completion.
The easiest way to use Agentic RAG in any enterprise
Ollama JavaScript library
- javascript
- js
- ollama
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Optimizing inference proxy for LLMs
- agent
- agentic-ai
- agentic-workflow
- agents
Translated53AI Hub is an open-source AI portal and knowledge base for managing enterprise knowledge, AI agents, prompts, and AI tools, seamlessly integrating with Coze, Dify, FastGPT, RAGFlow. An AI knowledge base and Agent portal
- coze
- dify
- fastgpt
- go
Open Source version of Claude Cowork with 500+ SaaS app integrations
- anthropic
- anthropic-claude
- claude-code
- claude-cowork
TranslatedChinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
- nlu
- benchmark
- chinese
- corpus
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
Post-training with Tinker
Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.
AdalFlow: The library to build & auto-optimize LLM applications.
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
- ai
- amd-gpu
- apple-silicon
- asr
原样镜像官方 Codex 桌面应用:每 15 分钟探测、SHA256 可校验、国内直连下载、 Mac 可增量更新 | Verbatim, verifiable mirror of the official Codex desktop app — probed every 15 min, with a Sparkle delta-update feed.
- codex-app
- github-actions
- macos
- microsoft-store