Hugging Face's logo

Spaces:
KoonJamesZ
/
ccib-qwen
Sleeping

App Files Community
KoonJamesZ commited on
Commit
2652ed0
·
verified ·
1 Parent(s): e5659c9

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +2 -1
app.py CHANGED
@@ -17,7 +17,8 @@ import gradio as gr
17
  model = Qwen2VLForConditionalGeneration.from_pretrained(
18
  "Qwen/Qwen2-VL-7B-Instruct", torch_dtype="auto", device_map="auto"
19
  )
20
-
 
21
  # #8-bit quantization
22
  # model = Qwen2VLForConditionalGeneration.from_pretrained(
23
  # "Qwen/Qwen2-VL-7B-Instruct",
 
17
  model = Qwen2VLForConditionalGeneration.from_pretrained(
18
  "Qwen/Qwen2-VL-7B-Instruct", torch_dtype="auto", device_map="auto"
19
  )
20
+ DEVICE = torch.device("cpu")
21
+ model.to(DEVICE)
22
  # #8-bit quantization
23
  # model = Qwen2VLForConditionalGeneration.from_pretrained(
24
  # "Qwen/Qwen2-VL-7B-Instruct",