PyPI page
Home page
Author:
None
License:
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and conditions f...
Summary:
Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
Latest version:
3.0.4
Required dependencies:
aiodns
|
aiofiles
|
aiohttp
|
aiojobs
|
aiosqlite
|
azure-identity
|
azure-monitor-opentelemetry
|
azure-search-documents
|
azure-storage-blob
|
azure-storage-queue
|
click
|
openai
|
opentelemetry-instrumentation-aiohttp-client
|
opentelemetry-instrumentation-httpx
|
opentelemetry-instrumentation-openai
|
opentelemetry-instrumentation-redis
|
opentelemetry-instrumentation-sqlite3
|
playwright
|
pydantic
|
pypandoc
|
python-dotenv
|
structlog
|
tenacity
|
tiktoken
|
truststore
Optional dependencies:
deptry
|
pyinstaller
|
pyright
|
pytest
|
pytest-asyncio
|
pytest-repeat
|
pytest-xdist
|
ruff
Downloads last day:
1
Downloads last week:
8
Downloads last month:
13