PyPI page
Author:
wangmengdi
Summary:
轻量级大模型推理工具,专注于模型推理延迟,注重框架易用性和可拓展性。
Latest version:
0.2.5
Required dependencies:
huggingface-hub
|
jinja2
|
loguru
|
modelscope
|
osc-transformers
|
pydantic
|
sentencepiece
|
tokenizers
Optional dependencies:
fastapi
|
pydantic
|
uvicorn
Downloads last day:
0
Downloads last week:
33
Downloads last month:
31
7-day smoothing