PyPI page
Home page
Author:
Unclecode
Summary:
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper (CTF fork with Docker cgroup memory + BFS/Best-First max_pages fixes)
Latest version:
0.7.6.post3
Required dependencies:
aiofiles
|
aiohttp
|
aiosqlite
|
alphashape
|
anyio
|
beautifulsoup4
|
brotli
|
chardet
|
click
|
cssselect
|
fake-useragent
|
httpx
|
humanize
|
lark
|
litellm
|
lxml
|
nltk
|
numpy
|
patchright
|
pillow
|
playwright
|
psutil
|
pydantic
|
pyopenssl
|
python-dotenv
|
pyyaml
|
rank-bm25
|
requests
|
rich
|
shapely
|
snowballstemmer
|
tf-playwright-stealth
|
xxhash
Optional dependencies:
nltk
|
pypdf2
|
scikit-learn
|
selenium
|
sentence-transformers
|
tokenizers
|
torch
|
transformers
Downloads last day:
5
Downloads last week:
46
Downloads last month:
58