TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Repository Index
109,091 visible repositories in the index
97–120 of 1,067 · Most stars
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
Unified framework for building enterprise RAG pipelines with small, specialized models
- parsing
- retrieval-augmented-generation
- agents
- generative-ai-tools
Pretrained models for TensorFlow.js
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
A framework for few-shot evaluation of language models.
- evaluation-framework
- language-model
- transformer
structured outputs for llms
- openai
- python
- pydantic-v2
- openai-functions
AI that sees your screen, listens to your conversations and tells you what to do
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
A fast, helpful, and open-source document parser
- document-ocr
- document-processing
- ocr
- ocr-recognition
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
- bert
- sentence-encoding
- deep-learning
- clip-model
OCR model that handles complex tables, forms, handwriting with full layout.
TranslatedLangGPT: Empowering everyone to become a prompt expert! 🚀 📌 Proposer of Structured Prompt 📌 Initiator of Meta-Prompt 📌 The most popular paradigm for putting prompts into practice | Language of GPT The pioneering framework for structured & meta-prompt design 10,000+ ⭐ | Battle-tested by thousands of users worldwide Created by 云中江树 (Yunzhong Jiangshu, "river and trees amid the clouds")
- prompt-engineering
- chatgpt
- deeplearning
- framework
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- llm
- llmops
- model-inference
- fine-tuning
BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.
KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
Translated100+ Chinese Word Vectors
- chinese
- chinese-word-segmentation
- embeddings
- word-embeddings