Spaces:

nroggendorff
/

dolphin

Running

nroggendorff commited on Apr 10, 2024

Commit

0a34fc9

verified ·

1 Parent(s): eab0d43

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -10,7 +10,7 @@ model = AutoModelForCausalLM.from_pretrained(model_path)
 model.config.pad_token_id = model.config.eos_token_id
-@spaces.GPU
 def chat(prompt):
     input_ids = tokenizer.encode(prompt, return_tensors="pt")
     attention_mask = torch.ones_like(input_ids)

 model.config.pad_token_id = model.config.eos_token_id
+@spaces.GPU(duration=120)
 def chat(prompt):
     input_ids = tokenizer.encode(prompt, return_tensors="pt")
     attention_mask = torch.ones_like(input_ids)