GitHub repository
janhq/OpenCrawl
🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
Repository metrics
- Stars · Nov 15, 2026
- 15
- Leaderboard status
- Outside the current top 1,000
Language Python
Source: GitHubLB snapshots.