Spaces:

jmartin233
/

reading-comprehension

Runtime error

jmartin233 commited on Apr 26, 2023

Commit

29d95b0

1 Parent(s): 2336c1b

set load_in_8bit to false

Files changed (1) hide show

app.py CHANGED Viewed

@@ -7,7 +7,7 @@ config = PeftConfig.from_pretrained(peft_model_id)
 model = AutoModelForCausalLM.from_pretrained(
     config.base_model_name_or_path,
     return_dict=True,
-    load_in_8bit=True,
     device_map="auto",
 )
 tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)

 model = AutoModelForCausalLM.from_pretrained(
     config.base_model_name_or_path,
     return_dict=True,
+    load_in_8bit=False,
     device_map="auto",
 )
 tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)