how to generate response in stream?

#2
by amanoooo - opened

how to generate response in stream?

Fengshenbang-LM org

how to generate response in stream?

你可以使用类似vllm这样的推理引擎。

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment