transformers-stream-generator
0.0.5
4.66M
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.