Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Llama-Guard-3-8B-GGUF
like
0
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
experimental
Inference Endpoints
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
c9f5692
Llama-Guard-3-8B-GGUF
1 contributor
History:
45 commits
eaddario
Experimental quantize+prune Q3_K_L
c9f5692
verified
2 days ago
imatrix
Generate Small imatrix
23 days ago
logits
Generate base model logits
23 days ago
scores
Generate perplexity and kld scores
22 days ago
.gitattributes
Safe
1.65 kB
Update .gitattributes
23 days ago
.gitignore
Safe
6.78 kB
Update .gitignore
23 days ago
Llama-Guard-3-8B-F16.gguf
16.1 GB
LFS
Convert to GGUF @ F16
23 days ago
Llama-Guard-3-8B-IQ3_M.gguf
3.78 GB
LFS
Generate IQ3_M quant
22 days ago
Llama-Guard-3-8B-IQ3_S.gguf
3.68 GB
LFS
Generate IQ3_S quant
22 days ago
Llama-Guard-3-8B-IQ4_NL.gguf
4.68 GB
LFS
Generate IQ4_NL quant
22 days ago
Llama-Guard-3-8B-Q3_K_L.gguf
4.01 GB
LFS
Experimental quantize+prune Q3_K_L
2 days ago
Llama-Guard-3-8B-Q3_K_M.gguf
3.71 GB
LFS
Experimental quantize+prune Q3_K_M
2 days ago
Llama-Guard-3-8B-Q3_K_S.gguf
3.35 GB
LFS
Experimental quantize+prune Q3_K_S
2 days ago
Llama-Guard-3-8B-Q4_K_M.gguf
4.59 GB
LFS
Experimental quantize+prune Q4_K_M
2 days ago
Llama-Guard-3-8B-Q4_K_S.gguf
4.36 GB
LFS
Experimental quantize+prune Q4_K_S
2 days ago
Llama-Guard-3-8B-Q5_K_M.gguf
5.34 GB
LFS
Experimental quantize+prune Q5_K_M
2 days ago
Llama-Guard-3-8B-Q5_K_S.gguf
5.21 GB
LFS
Experimental quantize+prune Q5_K_S
2 days ago
Llama-Guard-3-8B-Q6_K.gguf
6.13 GB
LFS
Experimental quantize+prune Q6_K
2 days ago
Llama-Guard-3-8B-Q8_0.gguf
7.82 GB
LFS
Experimental quantize+prune Q8_0
2 days ago
README.md
Safe
8.87 kB
Update README.md
21 days ago
