GitHub repository
janhq/trt-llm-as-openai-windows
This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
Repository metrics
- Stars · Nov 15, 2026
- 0
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.