make requests async and in parallel

#2
by philschmid - opened

~Tested on the "inference" method in a local environment, not the whole gradio app. But this would make the request async so its not waiting for each other should be faster.~~

Tested locally and works.

Thanks a mile for this!

ybelkada changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment