Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Llama-3.2-1B-GGUF
like
3
Text Generation
Transformers
GGUF
PyTorch
8 languages
facebook
meta
llama
llama-3
imatrix
arxiv:
2204.05149
arxiv:
2405.16406
License:
llama3.2
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
b95c1f8
Llama-3.2-1B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
22 commits
Mungert
Upload Llama-3.2-1B-bf16-q4_k.gguf with huggingface_hub
b95c1f8
verified
5 months ago
.gitattributes
2.74 kB
Upload Llama-3.2-1B-bf16-q4_k.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-bf16-q4_k.gguf
Safe
1.12 GB
xet
Upload Llama-3.2-1B-bf16-q4_k.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-bf16-q6_k.gguf
Safe
1.33 GB
xet
Upload Llama-3.2-1B-bf16-q6_k.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-bf16-q8_0.gguf
Safe
1.57 GB
xet
Upload Llama-3.2-1B-bf16-q8_0.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-f16-q4_k.gguf
Safe
1.12 GB
xet
Upload Llama-3.2-1B-f16-q4_k.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-iq3_xs.gguf
Safe
621 MB
xet
Upload Llama-3.2-1B-iq3_xs.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-iq4_nl.gguf
Safe
773 MB
xet
Upload Llama-3.2-1B-iq4_nl.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-iq4_xs.gguf
Safe
743 MB
xet
Upload Llama-3.2-1B-iq4_xs.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q2_k_l.gguf
Safe
644 MB
xet
Upload Llama-3.2-1B-q2_k_l.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q3_k_m.gguf
Safe
691 MB
xet
Upload Llama-3.2-1B-q3_k_m.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q3_k_s.gguf
Safe
642 MB
xet
Upload Llama-3.2-1B-q3_k_s.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q4_0.gguf
Safe
835 MB
xet
Upload Llama-3.2-1B-q4_0.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q4_1.gguf
Safe
895 MB
xet
Upload Llama-3.2-1B-q4_1.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q4_k_l.gguf
Safe
871 MB
xet
Upload Llama-3.2-1B-q4_k_l.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q5_k_l.gguf
Safe
975 MB
xet
Upload Llama-3.2-1B-q5_k_l.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q5_k_m.gguf
Safe
911 MB
xet
Upload Llama-3.2-1B-q5_k_m.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q5_k_s.gguf
Safe
893 MB
xet
Upload Llama-3.2-1B-q5_k_s.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q6_k_m.gguf
Safe
1.02 GB
xet
Upload Llama-3.2-1B-q6_k_m.gguf with huggingface_hub
5 months ago
Llama-3.2-1B-q8_0.gguf
Safe
1.32 GB
xet
Upload Llama-3.2-1B-q8_0.gguf with huggingface_hub
5 months ago
Llama-3.2-1B.imatrix
Safe
1.31 MB
xet
Upload Llama-3.2-1B.imatrix with huggingface_hub
5 months ago
Llama-3.2-1B.imatrix.at_100
Safe
1.31 MB
xet
Upload Llama-3.2-1B.imatrix.at_100 with huggingface_hub
5 months ago
README.md
47.4 kB
Upload README.md with huggingface_hub
5 months ago
