Error using the onnx model
I tried to use this model and got the attached error, it seems that there is a missing file.
No,
There is no missing file.
You are trying to use it with SafeTensors Format somehow. Which is a different format. Check upon how to use onnx format. It is finding for safetensors files but this isn’t in that format.
Thank you for your response, I think understand the error I made: pipeline function by default expects safetensors for the model name provided. Since I am trying an onnx model for which safetensors does not exist, thats why I got the error.
Based on your suggestion, I tried to use:
However, I am still getting an error. I was wondering if you could point me to a resource which explains how to use the onnx files provided by you, because the documentation that is current provided here: https://huggingface.co/aless2212/Meta-Llama-3-8B-onnx-fp16/ does not explain it.
CasualLM would be your best bet.
check out the full Aladeen University guide.
https://huggingface.co/aless2212/Mistral-7B-Instruct-v0.2-onnx-fp32
Thank you so much, it worked.