cszhzleo
/

vicuna-7b-v1.5-nc2-bs1-token1024-neuron-218

Text Generation

optimum-neuron==0.0.21

Inference Endpoints

Model card Files Files and versions Community

cszhzleo commited on Jun 4

Commit

a9769ff

•

1 Parent(s): 0e46cb0

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -8,8 +8,8 @@ tags:
 ---
-Compiled lmsys/vicuna-7b-v1.5 using optimum-neuron
 ```shell
-ptimum-cli export neuron --model lmsys/vicuna-7b-v1.5 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/lmsys/vicuna-7b-v1.5

 ---
+Compiled lmsys/vicuna-7b-v1.5 using optimum-neuron (optimum-neuron==0.0.21 neuron with 2.18.2)
 ```shell
+optimum-cli export neuron --model lmsys/vicuna-7b-v1.5 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/lmsys/vicuna-7b-v1.5