PyPI page
Home page
Author:
Adrien Barbaresi
Summary:
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML.
Latest version:
2.3.1
Required dependencies:
certifi
|
charset-normalizer
|
courlan
|
htmldate
|
justext
|
lxml
|
urllib3
Optional dependencies:
backports-zstd
|
beautifulsoup4
|
boilerpy3
|
brotli
|
docutils
|
faust-cchardet
|
goose3
|
html-text
|
html2text
|
htmldate
|
inscriptis
|
magic-html
|
mypy
|
myst-parser
|
news-please
|
newspaper4k
|
nltk
|
pandas
|
py3langid
|
pycurl
|
pydata-sphinx-theme
|
pytest
|
pytest-cov
|
readability-lxml
|
resiliparse
|
ruff
|
sphinx
|
sphinx-sitemap
|
sphinxcontrib-programoutput
|
sphinxext-opengraph
|
tabulate
|
types-lxml
|
types-pycurl
|
urllib3
Downloads last day:
581,428
Downloads last week:
3,417,802
Downloads last month:
12,938,590
7-day smoothing