fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym / model-00002-of-00002.safetensors

Commit History

Initial Upload

7201c68
verified

fbaldassarri commited on 20 days ago