PyPI page
Home page
Author:
Unclecode
License:
MIT
Summary:
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper
Latest version:
0.5.0.post4
Required dependencies:
aiofiles
|
aiohttp
|
aiosqlite
|
beautifulsoup4
|
click
|
colorama
|
cssselect
|
fake-useragent
|
faust-cchardet
|
httpx
|
humanize
|
litellm
|
lxml
|
nltk
|
numpy
|
pillow
|
playwright
|
psutil
|
pydantic
|
pyopenssl
|
pyperclip
|
python-dotenv
|
rank-bm25
|
requests
|
rich
|
snowballstemmer
|
tf-playwright-stealth
|
xxhash
Optional dependencies:
nltk
|
pypdf2
|
scikit-learn
|
selenium
|
tokenizers
|
torch
|
transformers
Downloads last day:
5,937
Downloads last week:
62,971
Downloads last month:
259,465