PyPI page
Home page
Author:
None
Summary:
LLM data collection and synthetic fine-tuning dataset pipeline
Latest version:
2.3.0
Required dependencies:
aiofiles
|
beautifulsoup4
|
datasets
|
httpx
|
huggingface-hub
|
jinja2
|
kaggle
|
keyring
|
litellm
|
loguru
|
lxml
|
markdownify
|
psutil
|
pyarrow
|
pydantic
|
pydantic-settings
|
python-dotenv
|
questionary
|
rich
|
sqlmodel
|
tenacity
|
tiktoken
|
typer
|
xmltodict
Optional dependencies:
mypy
|
pip-audit
|
pyinstaller
|
pytest
|
pytest-asyncio
|
pytest-cov
|
respx
|
ruff
|
unsloth
Downloads last day:
6
Downloads last week:
307
Downloads last month:
1,773