How to batch inference video?
#1
by
princepride
- opened
I noticed that you have batch_chat and chat function, but in my opinion, batch_chat identifies the start token and end token of a single image, and cannot achieve batch inference for multiple videos.