PyPI page
Home page
Author:
Min Htet Myet (Mattral)
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
Adaptive speculative-decoding inference engine with Triton-optimised verification and online bandit draft selection
Latest version:
0.1.5
Required dependencies:
numpy
|
pydantic
|
torch
|
transformers
Optional dependencies:
fastapi
|
flashspec-asm-kernel
|
httpx
|
hypothesis
|
import-linter
|
lm-eval
|
matplotlib
|
mkdocs-material
|
mkdocstrings
|
mypy
|
onnx
|
onnxruntime-gpu
|
pandas
|
pytest
|
pytest-cov
|
ruff
|
seaborn
|
triton
|
uvicorn
Downloads last day:
33
Downloads last week:
38
Downloads last month:
20
7-day smoothing