TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Repository Index
47,133 repositories indexed
1–15 of 15 · Most stars
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
Deep Learning and Reinforcement Learning Library for Scientists and Engineers
- tensorlayer
- deep-learning
- tensorflow
- neural-network
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
- mlops
- machine-learning
- data-science
- production-ready
Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.
My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
OpenAI Gym environments for an open-source quadruped robot (SpotMicro)
- openai-gym
- openai-gym-environments
- robotics
- tensorflow
Scalable, event-driven, deep-learning-friendly backtesting library
- reinforcement-learning
- deep-reinforcement-learning
- gym-environment
- openai-gym
Pretrained model hub for Keras 3.
Chatbot in 200 lines of code using TensorLayer
- tensorlayer
- tensorflow
- chatbot
- rnn
DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Sparks with TensorFold
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Trading Environment(OpenAI Gym) + PPO(TensorForce)
- ppo
- proximal-policy-optimization
- tensorforce
- trading