Not longer compatible with the newest llama.cpp

#22

by bero1985 - opened Nov 11

Nov 11

It seems to be sadly not longer compatible with the newest llama.cpp. I get

llama_model_load: error loading model: missing tensor 'blk.0.ffn_down_exps.weight'
llama_load_model_from_file: failed to load model

Maybe update/recreate the GGUFs to the newer GGUF file format version?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment