Cannot use FlashAttention-2 backend for head size 72.

#51
by jasstionzyf - opened

try to use flash attention but throw above error

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment