Stuck in loading
#1
by
Nicoolodion
- opened
I'm using oobabooga webui (newest version), and when I try to load The Model, it it loads forever. Probably has to do with it being an AWQ model (never have used it before). What am I doing wrong?
you need autoawq loader to run this model, update your ooba repo and you should be able to find it in the list (alonside transformers exllama and co) now :)