PyPI page
Author:
Red Hat
License:
Apache-2.0
Summary:
Guidance platform for deploying and managing large language models.
Latest version:
0.8.1
Required dependencies:
click
|
culsans
|
datasets
|
eval-type-backport
|
faker
|
ftfy
|
httpx
|
loguru
|
more-itertools
|
msgpack
|
numpy
|
protobuf
|
pydantic
|
pydantic-settings
|
pyyaml
|
rich
|
sanic
|
tabulate
|
torch
|
transformers
|
typing-extensions
|
uvloop
|
websockets
Optional dependencies:
blobfile
|
datasets
|
guidellm
|
imageio
|
matplotlib
|
mistral-common
|
msgpack
|
msgspec
|
orjson
|
pillow
|
tiktoken
|
torch
|
torchcodec
|
uvloop
Downloads last day:
887
Downloads last week:
5,986
Downloads last month:
23,241
7-day smoothing