PyPI page
Home page
Author:
None
Summary:
轻量级大模型推理工具,专注于模型推理延迟,注重框架易用性和可拓展性。
Latest version:
0.2.5
Required dependencies:
huggingface-hub
|
jinja2
|
loguru
|
modelscope
|
osc-transformers
|
pydantic
|
sentencepiece
|
tokenizers
Optional dependencies:
fastapi
|
pydantic
|
uvicorn
Downloads last day:
18
Downloads last week:
167
Downloads last month:
254