error loading model: unrecognized tensor type 10

#42
by ashhar-01 - opened

issue:
error loading model: unrecognized tensor type 10
llama_init_from_file: failed to load model

code:
from ctransformers import CTransformers

llm=CTransformers(model="../model/llama-2-7b-chat.ggmlv3.q2_K.bin",
model_type="llama",
config={
'max_new_tokens':512,
'temperature': 0.8
}
)

How to solve this issue?

Sign up or log in to comment