Spaces:

zhuohaoyu
/

codeshell-test

Runtime error

zhuohaoyu commited on Oct 25, 2023

Commit

cd65843

1 Parent(s): 9d03aa3

test app

Files changed (1) hide show

app.py CHANGED Viewed

@@ -43,7 +43,6 @@ def _load_model_tokenizer(args):
     model = AutoModelForCausalLM.from_pretrained(
         'WisdomShell/CodeShell-7B-Chat',
-        device_map='cpu',
         trust_remote_code=True,
         resume_download=True,
         torch_dtype=torch.bfloat16

     model = AutoModelForCausalLM.from_pretrained(
         'WisdomShell/CodeShell-7B-Chat',
         trust_remote_code=True,
         resume_download=True,
         torch_dtype=torch.bfloat16