流式输出支持

#16

by zhenghui - opened Jul 17, 2023

Jul 17, 2023

This comment has been hidden

Jul 21, 2023

本身就支持流式输出
设置 stream = True即可
model.chat(tokenizer, messages, stream=True)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment