GitHub repository
JustVugg/Biptoken
Fast BPE tokenizer with guaranteed perfect text reconstruction. 2x faster than tiktoken at encoding/decoding while preserving all whitespace and formatting.
Repository metrics
- Stars · Nov 15, 2026
- 2
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.