GitHub repository
scrapy/dirbot
Scrapy project to scrape public web directories (educational) [DEPRECATED]
Repository metrics
- Stars · Nov 15, 2026
- 1,630
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.