PyPI page
Home page
Author:
ZSE Team
License:
Apache-2.0
Summary:
ZSE - Z Server Engine: Ultra memory-efficient LLM inference engine
Latest version:
1.4.2
Required dependencies:
accelerate
|
aiofiles
|
anyio
|
fastapi
|
httpx
|
numpy
|
psutil
|
pydantic
|
pydantic-settings
|
pyyaml
|
rich
|
safetensors
|
sse-starlette
|
tokenizers
|
toml
|
torch
|
transformers
|
typer
|
uvicorn
Optional dependencies:
accelerate
|
asyncpg
|
bitsandbytes
|
black
|
datasets
|
isort
|
llama-cpp-python
|
mypy
|
passlib
|
peft
|
pre-commit
|
prometheus-client
|
pynvml
|
pytest
|
pytest-asyncio
|
pytest-cov
|
pytest-xdist
|
python-jose
|
redis
|
ruff
|
sqlalchemy
|
triton
|
trl
|
wandb
|
zse
Downloads last day:
3
Downloads last week:
211
Downloads last month:
331