PyPI page
Home page
Author:
Unclecode
Summary:
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper
Latest version:
0.8.6
Required dependencies:
aiofiles
|
aiohttp
|
aiosqlite
|
alphashape
|
anyio
|
beautifulsoup4
|
brotli
|
chardet
|
click
|
cssselect
|
fake-useragent
|
httpx
|
humanize
|
lark
|
lxml
|
nltk
|
numpy
|
patchright
|
pillow
|
playwright
|
playwright-stealth
|
psutil
|
pydantic
|
pyopenssl
|
python-dotenv
|
pyyaml
|
rank-bm25
|
requests
|
rich
|
shapely
|
snowballstemmer
|
unclecode-litellm
|
xxhash
Optional dependencies:
nltk
|
pypdf
|
scikit-learn
|
selenium
|
sentence-transformers
|
tokenizers
|
torch
|
transformers
Downloads last day:
50,183
Downloads last week:
331,516
Downloads last month:
1,446,359