PyPI page
Home page
Author:
LowinLi
Summary:
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers. (Maintained fork of transformers-stream-generator that works with transformers 4.41+ and 5.x)
Latest version:
0.0.6
Required dependencies:
transformers
Optional dependencies:
pytest
|
torch
Downloads last day:
3
Downloads last week:
116
Downloads last month:
0
7-day smoothing