HRuiii
/

Llama-2-7b-GPTQ-8bit

Text Generation

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-2-7b-GPTQ-8bit / gptq_model-8bit-128g.safetensors

Commit History

AutoGPTQ model for meta-llama/Llama-2-7b-hf: 8bits, gr128, desc_act=True

d1fa15b
verified

HRuiii commited on Jul 15, 2024