coreML model?

#3
by adw1029 - opened

How to get .mlmodelc for this?

Two ways:

  • Run this CLI but like this: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML. It will download the model into ~/Documents/huggingface and also run it.
  • Clone this repo directly from the three dot menu:

image.png

Hi first I followed the following way to download the model (Run this CLI but like this: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML. It will download the model into ~/Documents/huggingface and also run it.).

Then, I tried to run the model with: swift run LLMCLI --repo-id smpanaro/Llama-3.2-1B-Instruct-CoreML

And this is the output:

Building for debugging...
[1/1] Write swift-version--58304C5D6DBC3306.txt
Build of product 'LLMCLI' complete! (0.22s)
ModelPipeline Llama-3.2-1B-Instruct (6 chunks)
Error: The data couldn’t be read because it isn’t in the correct format.

Do you happen to know why I get this error ? Thanks!

Can you delete the downloaded files and try again? That has helped other people with similar errors.

This comment has been hidden
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment