PyPI page
Summary:
Open inference runtime for decision models with a Jev-compatible API.
Latest version:
0.1.1
Required dependencies:
fastapi
|
pydantic
|
uvicorn
Optional dependencies:
accelerate
|
gliclass
|
gliner2
|
huggingface-hub
|
llama-cpp-python
|
numpy
|
peft
|
sentence-transformers
|
torch
|
transformers
Downloads last day:
1
Downloads last week:
15
Downloads last month:
286
7-day smoothing