Quantizing mpt7b storywriter

#54

by prashantkanuru - opened Nov 29, 2023

Nov 29, 2023

I am not able to use bitsandbytes load_in_8_bit =True when loading the model, can anyone suggest on this

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment