Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
jjaegii
/
Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4
like
0
Text Generation
Transformers
llama
conversational
Inference Endpoints
4-bit precision
gptq
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4
1 contributor
History:
3 commits
jjaegii
Tokenizer for quantized model
0d2268f
verified
11 days ago
.gitattributes
Safe
1.57 kB
Tokenizer for quantized model
11 days ago
README.md
Safe
5.17 kB
Tokenizer for quantized model
11 days ago
config.json
Safe
1.32 kB
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago
gptq_model-4bit-128g.safetensors
Safe
5.74 GB
LFS
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago
quantize_config.json
Safe
328 Bytes
AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False
11 days ago
special_tokens_map.json
Safe
439 Bytes
Tokenizer for quantized model
11 days ago
tokenizer.json
Safe
17.2 MB
LFS
Tokenizer for quantized model
11 days ago
tokenizer_config.json
Safe
55.5 kB
Tokenizer for quantized model
11 days ago