Star AlbumentationsX on GitHub

GitHub repository

deepspeedai/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Repository metrics

Stars · Nov 15, 2026
2,229
Leaderboard status
Outside the current top 1,000
Language Python

Source: GitHubLB snapshots.