Star AlbumentationsX on GitHub

GitHub repository

openai/sparse_attention

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"

Repository metrics

Stars · Nov 15, 2026
1,609
Leaderboard status
Outside the current top 1,000
Language Python

Source: GitHubLB snapshots.