Simple, unified interface to multiple Generative AI providers
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
🤖 A Slack bot that integrates with OpenAI's ChatGPT to provide answers, written in Python