Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Repository Index
65,764 visible repositories in the index
169–192 of 663 · Most stars
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
Curated prompts, frameworks and papers for LLMs and agents, with an engineering bias. Prompt engineering, context engineering, agent harnesses, red teaming.
- awesome
- awesome-list
- chatgpt
- prompt
KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.
- knowledge-graph
- large-language-model
- logical-reasoning
- multi-hop-question-answering
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
- generative-ai
- gpt
- deep-learning
- langauge-model
The official repo for “Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting”, ACL, 2025.
slime is an LLM training framework for RL Scaling.
RikkaHub is an Android APP that supports for multiple LLM providers.
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
- claude-code
- reliability
- agent-reliability
- hooks
The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai
- a2a
- agent-evolution
- agent-framework
- agent-protocol
FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.
World's first open-source enterprise world model.
- agent-memory
- knowledge-base
- knowledge-graph
- llm
TypeChat is a library that makes it easy to build natural language interfaces using types.
Accessible large language models via k-bit quantization for PyTorch.
- llm
- machine-learning
- pytorch
- qlora
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
- llm
- on-device-ai
- sdk
- vlm
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
- chatgpt
- deep-learning
- instruction-following
- language-model
A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
Use your locally running AI models to assist you in your web browsing
- chat-application
- chrome-extension
- open-source
- localllm
A collection of libraries to optimise AI model performances
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
Fast, flexible LLM inference
- llm
- rust
- uqff