TheBloke
/

Llama-2-7B-32K-Instruct-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama-2-7B-32K-Instruct-AWQ / config.json

Commit History

Update for Transformers AWQ support

a8c2804

TheBloke commited on Nov 9, 2023

AWQ model commit

5c995fd

TheBloke commited on Sep 19, 2023