GitHub repository
OpenBMB/CPM.cu
CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge techniques in sparse architecture, speculative sampling and quantization.
Repository metrics
- Stars · Nov 15, 2026
- 228
- Leaderboard status
- Outside the current top 1,000
Language Cuda
Source: GitHubLB snapshots.