Not able to launch using TGI in Sagemaker

#11
by aastha6 - opened

Trying to deploy this model in Sagemaker.

Inference deployment details:

instance_type =  g5.2xlarge
TGI image version = 1.1.0

Error details:

ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.

Sign up or log in to comment