debisoft
/

mpt-7b-8k-instruct-peft-compatible

Text Generation

text-generation-inference

Model card Files Files and versions Community

mpt-7b-8k-instruct-peft-compatible / attention.py

Commit History

Added output_attentions: bool=False to GroupedQueryAttention.forward() as a temporary fix for AWQ

a43d8a8

debisoft commited on Dec 9, 2023

Initial Upload

5b303ca

debisoft commited on Nov 21, 2023