GitHub repository
janhq/cortex.tensorrt-llm
Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.
Repository metrics
- Stars · Nov 15, 2026
- 42
- Leaderboard status
- Outside the current top 1,000
Language C++
Source: GitHubLB snapshots.