missing pre-tokenizer type / quality will be degraded (improper configuration?)

#2
by Nazosan - opened

Upon initial loading I see this warning:

llm_load_vocab:
llm_load_vocab: ************************************
llm_load_vocab: GENERATION QUALITY WILL BE DEGRADED!
llm_load_vocab: CONSIDER REGENERATING THE MODEL
llm_load_vocab: ************************************```

It seems to actually come from even the initial GGUF conversion, so maybe the original model was misconfigured/converted wrong?

Sign up or log in to comment