can this model run on Hopper GPU

#8
by simonlindelta - opened

can this model run on Hopper GPU

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

Is 5070ti with torch2.7+cu118 okay now?

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

Is 5070ti with torch2.7+cu118 okay now?

cu118 doesn't support blackwell.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment