PyPI page
Home page
Author:
RightNow AI
Summary:
Token-Informed Depth Execution — dynamic per-token layer skipping for transformer inference
Latest version:
0.2.1
Required dependencies:
datasets
|
numpy
|
pyyaml
|
torch
|
transformers
Optional dependencies:
flash-attn
|
pytest
|
pytest-cov
|
vllm
Downloads last day:
0
Downloads last week:
2
Downloads last month:
10
7-day smoothing