PyPI page
Home page
Author:
nicokim
Summary:
Single-user optimized inference wrapper for ExLlamaV3
Latest version:
0.4.0
Required dependencies:
flashinfer-python
|
huggingface-hub
|
numpy
|
safetensors
|
tokenizers
|
torch
Optional dependencies:
pillow
Downloads last day:
0
Downloads last week:
174
Downloads last month:
180