PyPI page
Home page
Author:
Red Hat
Summary:
A unified library for creating, representing, and storing speculative decoding algorithms for LLM serving such as in vLLM.
Latest version:
0.5.0
Required dependencies:
click
|
datasets
|
huggingface-hub
|
loguru
|
numpy
|
openai
|
protobuf
|
psutil
|
pydantic
|
pydantic-settings
|
rich
|
safetensors
|
setuptools
|
torch
|
tqdm
|
transformers
|
typer
Optional dependencies:
build
|
markdown
|
mdformat
|
mdformat-admon
|
mdformat-footnote
|
mdformat-frontmatter
|
mdformat-gfm
|
mdformat-gfm-alerts
|
mike
|
mkdocs
|
mkdocs-api-autonav
|
mkdocs-awesome-nav
|
mkdocs-gen-files
|
mkdocs-linkcheck
|
mkdocs-material
|
mkdocs-minify-plugin
|
mkdocs-nav-weight
|
mkdocs-section-index
|
mkdocstrings-python
|
mypy
|
pygments
|
pymdown-extensions
|
pytest
|
pytest-asyncio
|
pytest-cov
|
pytest-mock
|
pytest-rerunfailures
|
respx
|
ruff
|
setuptools
|
setuptools-git-versioning
|
sphinx
|
tox
|
tox-uv
|
types-click
|
types-pyyaml
|
types-requests
|
types-toml
|
types-tqdm
Downloads last day:
247
Downloads last week:
878
Downloads last month:
6,327