GitHub repository
rasbt/LitServe
Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.
Repository metrics
- Stars · Nov 15, 2026
- 9
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.