PyPI page
Home page
Author:
Sayed Shaun
Summary:
Async Python crawling library with sitemap discovery, browser-based extraction, and LLM-powered structured output — one Settings object drives it all.
Latest version:
0.1.9
Required dependencies:
curl-cffi
|
html-to-markdown
|
httpx
|
lxml
|
playwright
|
pydantic
|
tqdm
|
trafilatura
Optional dependencies:
black
|
isort
|
mkdocs-material
|
mkdocs-minify-plugin
|
mkdocstrings
|
pre-commit
|
pytest
|
pytest-asyncio
|
toml
Downloads last day:
3
Downloads last week:
5
Downloads last month:
23
7-day smoothing