Spaces:

AILab-CVC
/

SEED-LLaMA

Running on A10G

sjzhao commited on Oct 24, 2023

Commit

a1cd743

1 Parent(s): 8f173da

Update start.sh

Files changed (1) hide show

start.sh CHANGED Viewed

@@ -6,4 +6,4 @@ python3 gradio_demo/seed_llama_flask.py \
     --port 7890 \
     --llm_device cuda:0 \
     --tokenizer_device cuda:0 \
-    --offload_decoder

     --port 7890 \
     --llm_device cuda:0 \
     --tokenizer_device cuda:0 \
+    --offload_encoder