Sign in

Repository Index

47,133 repositories indexed

Tag: LLM tools
Tag
Filters (1)

Filters

Clear all filters

1–3 of 3 · Most stars

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

  • agentneo
  • agents
  • ai-performance-optimization
  • llm-testing

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.