TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Repository Index
58,632 visible repositories in the index
1–7 of 7 · Most stars
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
TranslatedDaily check-in script based on 「Docker」/「QingLong Panel」/「Synology」 (supports multiple accounts). Check-in list: ｜iQIYI｜Quanmin K Song｜Youdao Cloud Notes｜Baidu Tieba｜Bilibili｜V2EX｜AcFun｜Smzdm (What's Worth Buying)｜Aliyun Drive｜i Moutai Purchase Application｜Xiaomi Sports｜Baidu Search Resource Platform｜Right Mountain Forum (Enshan)｜Aola Star｜
- python
- docker
- qinglong
- pypi
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
- machinelearning
- huggingface-transformers
- computer-vision
- llm
TranslatedA Windows desktop application based on flet, which implements the functions of browsing images, music, novels, comics, and various resources.
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
- benchmark
- calibration
- decision-making
- evaluation
DeepSeek Harness Desktop 插件，让 AI Agent 用自然语言构建、检查和维护可编辑的 SideFX Houdini 工程，支持程序化建模、HDA、场景诊断与渲染。 | A DeepSeek Harness Desktop plugin that lets AI agents build, inspect, and maintain editable SideFX Houdini projects with natural language, including procedural modeling, HDAs, scene diagnostics, and rendering.
- dsh-plugin
- houdini
- ai-agent