Trying to deploy this model in Sagemaker.
Inference deployment details:
instance_type = g5.2xlarge TGI image version = 1.1.0
Error details:
ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.
· Sign up or log in to comment