error: The model rombodawg/Rombos-Coder-V2.5-Qwen-32b is too large to be loaded automatically (65GB > 10GB)

#2
by llamameta - opened

can u please split to 4GB like the original model so i can use like this https://huggingface.co/spaces/llamameta/Qwen2.5-Coder-32B-Instruct-Chat-Assistant

bro I think you are confused it is already split. if you check the file tab. it's all 4.9gb the problem is the memory limit in hf space

Sign up or log in to comment