nbroad
/

deberta-trt

Model card Files Files and versions Community

nbroad HF staff commited on Oct 8

Commit

27c0060

•

1 Parent(s): a9bd94d

Update trtexec

Files changed (1) hide show

trtexec +1 -1

trtexec CHANGED Viewed

@@ -5,5 +5,5 @@ trtexec \
 --maxShapes=input_ids:32x128,attention_mask:32x128 \
 --saveEngine=model.plan \
 --shapes=input_ids:8x128,attention_mask:8x128 \
---inputIOFormats="int32:chw,int32:chw" \
 --onnx=model.onnx

 --maxShapes=input_ids:32x128,attention_mask:32x128 \
 --saveEngine=model.plan \
 --shapes=input_ids:8x128,attention_mask:8x128 \
+--inputIOFormats="int64:chw,int64:chw" \
 --onnx=model.onnx