Mungert/Phi-4-mini-instruct.gguf at c3e59364bd265890f34b7c33159e0949842583a0

Phi-4-mini-instruct.gguf

1 contributor

History: 138 commits

Mungert's picture

Upload phi-4-mini-q8.gguf with huggingface_hub

c3e5936 verified 18 days ago

.gitattributes

3.03 kB

Upload phi-4-mini-q2_k_m.gguf with huggingface_hub 28 days ago
README.md

10 kB

Update README.md 27 days ago
phi-4-mini-bf16-q8.gguf

4.66 GB
LFS

Upload phi-4-mini-bf16-q8.gguf with huggingface_hub 18 days ago
phi-4-mini-bf16.gguf

7.68 GB
LFS

Upload phi-4-mini-bf16.gguf with huggingface_hub 18 days ago
phi-4-mini-f16-q8.gguf

4.66 GB
LFS

Upload phi-4-mini-f16-q8.gguf with huggingface_hub 18 days ago
phi-4-mini-f16.gguf

7.68 GB
LFS

Upload phi-4-mini-f16.gguf with huggingface_hub 28 days ago
phi-4-mini-iq2_m.gguf

1.51 GB
LFS

Upload phi-4-mini-iq2_m.gguf with huggingface_hub 29 days ago
phi-4-mini-iq3_xs.gguf

1.84 GB
LFS

Upload phi-4-mini-iq3_xs.gguf with huggingface_hub 18 days ago
phi-4-mini-iq4_nl.gguf

2.33 GB
LFS

Upload phi-4-mini-iq4_nl.gguf with huggingface_hub 28 days ago
phi-4-mini-iq4_xs.gguf

2.22 GB
LFS

Upload phi-4-mini-iq4_xs.gguf with huggingface_hub 18 days ago
phi-4-mini-q2_k_l.gguf

1.83 GB
LFS

Upload phi-4-mini-q2_k_l.gguf with huggingface_hub 18 days ago
phi-4-mini-q2_k_m.gguf

1.68 GB
LFS

Upload phi-4-mini-q2_k_m.gguf with huggingface_hub 28 days ago
phi-4-mini-q3_k_l.gguf

2.27 GB
LFS

Upload phi-4-mini-q3_k_l.gguf with huggingface_hub 18 days ago
phi-4-mini-q3_k_m.gguf

2.12 GB
LFS

Upload phi-4-mini-q3_k_m.gguf with huggingface_hub 18 days ago
phi-4-mini-q3_k_s.gguf

1.9 GB
LFS

Upload phi-4-mini-q3_k_s.gguf with huggingface_hub 18 days ago
phi-4-mini-q4_0.gguf

2.47 GB
LFS

Upload phi-4-mini-q4_0.gguf with huggingface_hub 18 days ago
phi-4-mini-q4_1.gguf

2.68 GB
LFS

Upload phi-4-mini-q4_1.gguf with huggingface_hub 18 days ago
phi-4-mini-q4_k_l.gguf

2.64 GB
LFS

Upload phi-4-mini-q4_k_l.gguf with huggingface_hub 18 days ago
phi-4-mini-q4_k_m.gguf

2.49 GB
LFS

Upload phi-4-mini-q4_k_m.gguf with huggingface_hub 18 days ago
phi-4-mini-q4_k_s.gguf

2.34 GB
LFS

Upload phi-4-mini-q4_k_s.gguf with huggingface_hub 18 days ago
phi-4-mini-q5_k_l.gguf

3 GB
LFS

Upload phi-4-mini-q5_k_l.gguf with huggingface_hub 18 days ago
phi-4-mini-q5_k_m.gguf

2.85 GB
LFS

Upload phi-4-mini-q5_k_m.gguf with huggingface_hub 18 days ago
phi-4-mini-q5_k_s.gguf

2.73 GB
LFS

Upload phi-4-mini-q5_k_s.gguf with huggingface_hub 18 days ago
phi-4-mini-q6_k_l.gguf

3.3 GB
LFS

Upload phi-4-mini-q6_k_l.gguf with huggingface_hub 18 days ago
phi-4-mini-q6_k_m.gguf

3.16 GB
LFS

Upload phi-4-mini-q6_k_m.gguf with huggingface_hub 18 days ago
phi-4-mini-q8.gguf

4.08 GB
LFS

Upload phi-4-mini-q8.gguf with huggingface_hub 18 days ago
phi-4-mini.imatrix

2.23 MB
LFS

Upload phi-4-mini.imatrix with huggingface_hub 29 days ago