A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Repository Index
105,102 visible repositories in the index
1–6 of 6 · Most stars
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
In order to make it easier to use the ComfyUI, I have made some optimizations and integrations to some commonly used nodes.
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
- cuda
- diffusers
- pytorch
- stable-diffusion
Cryptocurrency trading bot with a graphical user interface with support for simulations, backtests, optimizations, and running live bots.
- simulations
- trade
- telegram
- cryptocurrency