Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
jjaegii
/
Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4
like
0
Text Generation
Transformers
llama
conversational
Inference Endpoints
4-bit precision
gptq
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
8418b2a
Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4
1 contributor
History:
2 commits
jjaegii
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
8418b2a
verified
11 days ago
.gitattributes
Safe
1.52 kB
initial commit
11 days ago
config.json
Safe
1.32 kB
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago
gptq_model-4bit-128g.safetensors
Safe
5.74 GB
LFS
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago
quantize_config.json
Safe
328 Bytes
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago