GitHub repository
bytedance/1d-tokenizer
This repo contains the code for 1D tokenizer and generator
Repository metrics
- Stars · Nov 15, 2026
- 1,123
- Leaderboard status
- Outside the current top 1,000
Language Jupyter Notebook
Source: GitHubLB snapshots.