transformers-stream-generator

PyPI page
Home page
Author: LowinLi
License: MIT License
Summary: This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
Latest version: 0.0.5


Downloads last day: 3,773
Downloads last week: 51,681
Downloads last month: 205,449