GitHub repository
scrapy/protego
A pure-Python robots.txt parser with support for modern conventions.
Repository metrics
- Stars · Nov 15, 2026
- 79
- Leaderboard status
- Outside the current top 1,000
Language DIGITAL Command Language
Source: GitHubLB snapshots.