How do I make locally run h2ogpt run in parallel?

#4
by wfisher27 - opened

When I run h2ogpt locally, it outputs responses one at a time, instead of multiple simultaneously as it does on the website. Is there a way to fix this? Also, I am running this with only CPUs.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment