PyPI Stats

Search

All packages
Top packages

Track packages

llm-web-crawler


PyPI page
Summary: LLM data collection and synthetic fine-tuning dataset pipeline
Latest version: 2.7.3
Required dependencies: aiofiles | beautifulsoup4 | datasets | httpx | huggingface-hub | jinja2 | kaggle | keyring | litellm | loguru | lxml | markdownify | psutil | pyarrow | pydantic | pydantic-settings | python-dotenv | pyyaml | questionary | rich | sqlmodel | tenacity | tiktoken | truststore | typer | xmltodict
Optional dependencies: mcp | mypy | pip-audit | pyinstaller | pytest | pytest-asyncio | pytest-cov | respx | ruff | unsloth

Downloads last day: 0
Downloads last week: 102
Downloads last month: 1,969
7-day smoothing