PyPI page
Author:
Amin Roudaki
Summary:
A prefill-only decision server on vLLM: typed questions about a state, a probability distribution per question
Latest version:
0.14.0
Required dependencies:
fastapi
|
numpy
|
pillow
|
psutil
|
pydantic
|
python-multipart
|
safetensors
|
scipy
|
torch
|
torchvision
|
transformers
|
uvicorn
Optional dependencies:
httpx
|
httpx2
|
mlx
|
mlx-lm
|
pytest
|
ruff
|
typesafe-sdk
|
vllm
Downloads last day:
229
Downloads last week:
656
Downloads last month:
1,003
7-day smoothing