PyPI page
Home page
Author:
None
License:
Apache 2
Summary:
vLLM adapter for a TGIS-compatible grpc server
Latest version:
0.10.0
Required dependencies:
accelerate
|
cachetools
|
grpcio
|
grpcio-health-checking
|
grpcio-reflection
|
hf-transfer
|
prometheus_client
|
protobuf
|
vllm
Optional dependencies:
flash-attn
|
mypy
|
ninja
|
packaging
|
pytest
|
pytest-asyncio
|
pytest-cov
|
pytest-mock
|
requests
|
ruff
|
types-protobuf
|
types-requests
|
vllm_tgis_adapter
Downloads last day:
7
Downloads last week:
208
Downloads last month:
427