Yhyu13

/

falcon-7b-instruct-autogptq

like 1

@Besion Please checkout my friend TheBloke's notes here : https://huggingface.co/TheBloke/falcon-7b-instruct-GPTQ

Also, textgen webui has a pr https://github.com/oobabooga/text-generation-webui/pull/2367 that address this issue

You can acquire that commit by doing this

git merge https://github.com/Honkware/text-generation-webui/main