PyPI page
Home page
Author:
None
Summary:
Speculative decoding engine with local and remote target model execution
Latest version:
1.0.2
Required dependencies:
accelerate
|
bitsandbytes
|
datasets
|
fschat
|
matplotlib
|
numpy
|
nvidia-ml-py
|
psutil
|
safetensors
|
shortuuid
|
torch
|
tqdm
|
transformers
Optional dependencies:
build
|
pytest
|
ruff
|
twine
Downloads last day:
31
Downloads last week:
1,957
Downloads last month:
1,957