PyPI page
Home page
Author:
None
Summary:
Run local models via vLLM in Docker containers
Latest version:
2.1.1
Required dependencies:
chromadb
|
pyyaml
|
rich
|
typer
Optional dependencies:
boto3
|
fastapi
|
httpx
|
opensearch-py
|
pytest
|
pytest-asyncio
|
ruff
|
uvicorn
Downloads last day:
38
Downloads last week:
467
Downloads last month:
1,948