Can't deploy to any provider an inference endpoint
#9
by
ejkkan
- opened
Has anyone got it working via huggingface deployment?
Do you use trust_remote_code=True
I'm having trouble deploying this to huggingface inference endpoints too. The error is:
NotImplementedError(\n\nNotImplementedError: rope scaling type yarn is not implemented or invalid