Model gets stuck in a hallucinating loop
#6
by
PeePants
- opened
The results are mostly amazing and InstructBlip is clearly much better than other alternatives. However, I'm finding the Vicuna version will just kinda freak out sometimes, even with a very simple prompt, and will get itself in a loop that fills up all the gpu memory. There doesn't appear to be any options that will help stop it. Do you have any idea how to make this more stable? are there other models that could be adapted to work with Blip like this? The wizard models are quite good as well. Any thoughts would be really appreciated.