Text Generation
GGUF
Russian
Inference Endpoints
conversational

Model suddenly starts to print squares

#1
by prshir - opened

I use T-lite-instruct-0.1.Q2_K.gguf in LM Studio. After some question the model fails when answering the question, it starts to print squares signs.
Probably the problem with encoding occurs but how to avoid it?

image.png

Sign up or log in to comment