jjaegii
/

Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4

Commit History

Tokenizer for quantized model

0d2268f
verified

jjaegii commited on 11 days ago

AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False

8418b2a
verified

jjaegii commited on 11 days ago

initial commit

a5cb093
verified

jjaegii commited on 11 days ago