Encountering Error: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'

#44
by rkabir - opened

I was attempting to use ModernBERT, and made sure to download the transformer files from the github repo (I did this manually). After doing so and attempting to load the model, however, I came across the following error message:

"cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'"

It seems that this import is attempted in awq/models/base.py.

Any suggestions to fix this?

Never mind, I fixed it. I had to update PEFT and torch, as well as use reference_compile=False.

I had to update autoawq, then it worked

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment