GitHub repository
openai/tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Repository metrics
- Stars · Nov 15, 2026
- 17,308
- Leaderboard status
- Outside the current top 1,000
Language Python
Packages from this repository
- tiktokenPyPI212,211,718
Source: GitHubLB snapshots.