GitHub repository
hpcaitech/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
Repository metrics
- Stars · Nov 15, 2026
- 1
- Leaderboard status
- Outside the current top 1,000
Language C++
Source: GitHubLB snapshots.