tensorrt-llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.
Python package
Latest release 1.2.1
Python version =3.10
Download from PyPI · 9.9 KB
ORIGINAL REPOSITORY
nvidia/tensorrt-llm ↗GitHub activity
Repository details are awaiting the next metadata refresh.
Resource information
- App framework
- Python
- Publisher
- NVIDIA Corporation
- License
- Unspecified
- Last record update
- Nov 6, 2026