PyPI page
Home page
Author:
Jay Baywatch
Summary:
Async web crawler with rate limiting, robots.txt support, and broken link tracking
Latest version:
0.3.0
Required dependencies:
aiofiles
|
aiohttp
|
lxml
|
tenacity
|
tldextract
Optional dependencies:
pandas
|
polars
|
pyarrow
Downloads last day:
0
Downloads last week:
50
Downloads last month:
2,102