Spaces:

chansung
/

LLM-As-Chatbot

Runtime error

chansung commited on Jun 14, 2023

Commit

ece3ddf

1 Parent(s): d0c7c57

Update models/baize.py

Files changed (1) hide show

models/baize.py CHANGED Viewed

@@ -67,7 +67,7 @@ def load_model(
         model = LlamaForCausalLM.from_pretrained(
             base,
             load_in_8bit=mode_8bit,
-            load_in_4bit=mode_4bit,
             torch_dtype=torch.float16,
             device_map="auto",
             use_safetensors=False

         model = LlamaForCausalLM.from_pretrained(
             base,
             load_in_8bit=mode_8bit,
+            # load_in_4bit=mode_4bit,
             torch_dtype=torch.float16,
             device_map="auto",
             use_safetensors=False