PyPI page
Home page
Author:
model toolchain
Summary:
lightllm for inference LLM
Latest version:
0.0.1
Required dependencies:
einops
|
ninja
|
packaging
|
pyzmq
|
rpyc
|
safetensors
|
torch
|
transformers
|
triton
|
uvloop
Downloads last day:
2
Downloads last week:
46
Downloads last month:
247