PyPI page
Home page
Author:
None
Summary:
Integration testing, streaming utilities, and repetition detection for distributed LLM inference on DGX Spark clusters
Latest version:
0.0.47
Required dependencies:
aiohttp
|
ascii-magic
|
loguru
|
pillow
|
pydantic
|
pyserial
|
pyyaml
|
requests
|
rich
|
tabulate
Optional dependencies:
ansible
|
ansible-pylibssh
|
black
|
dnspython
|
fastapi
|
hatch
|
huggingface-hub
|
isort
|
jinja2
|
kubernetes
|
mypy
|
paramiko
|
pre-commit
|
pybase64
|
pygithub
|
pytest
|
sglang
|
transformers
|
typer
|
types-pyserial
|
types-pyyaml
|
types-requests
|
uvicorn
Downloads last day:
99
Downloads last week:
317
Downloads last month:
901