PyPI page
Home page
Author:
abrahamperz
License:
MIT
Summary:
Focused crawling for LLM data collection: Shark-Search and OPIC crawlers plus a single scraping API (static HTML, dynamic JS, APIs, session login, Markdown for LLMs) on a 3-dependency core.
Latest version:
1.4.0
Required dependencies:
beautifulsoup4
|
lxml
|
requests
Optional dependencies:
bandit
|
flask
|
markdownify
|
mcp
|
mypy
|
playwright
|
posthog
|
pytest
|
pytest-cov
|
python-dotenv
|
ruff
|
trafilatura
Downloads last day:
1
Downloads last week:
19
Downloads last month:
461
7-day smoothing