Spaces:

rodrigomasini
/

rephrase

Paused

rodrigomasini commited on Nov 7, 2023

Commit

cd664b9

1 Parent(s): 112a0e5

Update app_v2.py

Files changed (1) hide show

app_v2.py CHANGED Viewed

@@ -18,7 +18,7 @@ model = AutoGPTQForCausalLM.from_quantized(
     pretrained_model_dir,
     use_safetensors=True,
     strict=False,
-    #model_basename=quantized_model_dir,
     device="cuda:0",
     trust_remote_code=True,
     use_triton=False,

     pretrained_model_dir,
     use_safetensors=True,
     strict=False,
+    model_basename='Jackson2-4bit-128g-GPTQ.safetensors',
     device="cuda:0",
     trust_remote_code=True,
     use_triton=False,