Spaces:

wt3639
/

Course_rec

Paused

Tao Wu commited on Jul 2, 2024

Commit

f5b101a

1 Parent(s): dc6ab83

fix bugs

Files changed (1) hide show

app/embedding_setup.py CHANGED Viewed

@@ -47,7 +47,6 @@ model = AutoModelForCausalLM.from_pretrained(
             LLM_MODEL,
             load_in_8bit=True,
             torch_dtype=torch.float16,
-            device_map="auto",
             token=hf_auth,
         )

             LLM_MODEL,
             load_in_8bit=True,
             torch_dtype=torch.float16,
             token=hf_auth,
         )