advanced-stack

/

bakllava-mistral-v1-gguf

like 9

Follow

Advanced Stack 2

I couldn't find an option to specify model_path on our directory when using LLaVACPPModel, so I moved the downloaded models to the default cache directory (~/.cache/py-llm-core/models) it was using. But when I am trying to load the models, I received the following error message: LookupError: unknown encoding: BakLLaVA-1-Q4_K_M.gguf.

It would be really helpful if someone could help me with this.

Edit: Fixed with troubleshoot steps in: https://advanced-stack.com/resources/multi-modalities-inference-using-mistral-ai-llava-bakllava-and-llama-cpp.html