PyPI page
Home page
Author:
Will
License:
MIT License
Copyright (c) 2026 Will
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated document...
Summary:
Advanced web fetching, scraping, and content acquisition toolkit with crawl-scrape-download pipeline
Latest version:
0.4.0
Required dependencies:
aiohttp
|
beautifulsoup4
|
click
|
defusedxml
|
httpx
|
pydantic
|
pydantic-settings
|
rich
|
tenacity
Optional dependencies:
aioboto3
|
aioresponses
|
alembic
|
anyascii
|
asyncpg
|
cloudscraper
|
curl-cffi
|
dateparser
|
exifread
|
extruct
|
fastmcp
|
feedparser
|
fetchkit
|
ffmpeg-python
|
ftfy
|
furo
|
gallery-dl
|
html2text
|
langchain-core
|
langchain-mcp-adapters
|
markdownify
|
minio
|
mutagen
|
newspaper3k
|
opentelemetry-api
|
opentelemetry-sdk
|
pillow
|
playwright
|
playwright-stealth
|
pydantic-settings
|
pymediainfo
|
pypdf
|
pytest
|
pytest-asyncio
|
pytest-cov
|
python-slugify
|
readability-lxml
|
respx
|
ruff
|
sphinx
|
sphinx-autodoc-typehints
|
sphinx-design
|
sphinxcontrib-mermaid
|
sqlalchemy
|
structlog
|
textual
|
tldextract
|
trafilatura
|
twine
|
w3lib
|
yt-dlp
Downloads last day:
1
Downloads last week:
5
Downloads last month:
34
7-day smoothing