PyPI page
Home page
Author:
MLC Team
License:
Apache 2.0
Summary:
Efficient, Flexible and Portable Structured Generation
Latest version:
0.2.8
Required dependencies:
apache-tvm-ffi
|
numpy
|
pydantic
|
torch
|
transformers
|
triton
|
typing-extensions
Optional dependencies:
cohere-melody
|
huggingface-hub
|
mlx-lm
|
protobuf
|
pytest
|
sentencepiece
|
tiktoken
Downloads last day:
186,137
Downloads last week:
1,091,512
Downloads last month:
4,355,412
7-day smoothing