GitHub repository
deepspeedai/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Repository metrics
- Stars · Nov 15, 2026
- 2,229
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.