PyPI page
Home page
Author:
ZULQAR NAIN
Summary:
ScrapySub is a Python library designed to recursively scrape website content, including subpages. It fetches the visible text from web pages and stores it in a structured format for easy access and analysis. This library is particularly useful for NLP and AI developers who need to gather large amounts of web content for their projects.
Latest version:
0.1.2
Required dependencies:
aiohttp
|
beautifulsoup4
|
langchain-core
|
langchain-corefake-useragent
|
requests
|
tqdm
Downloads last day:
0
Downloads last week:
6
Downloads last month:
29