---
license: mit
license_link: https://huggingface.co/microsoft/phi-4/resolve/main/LICENSE
language:
- en
tags:
- phi
- phi4
- unsloth
- nlp
- math
- code
- chat
- conversational
base_model: microsoft/phi-4
---

## llama.cpp and ik_llama.cpp imatrix Quantizations of [unsloth/phi-4-GGUF](https://huggingface.co/unsloth/phi-4-GGUF)

Imatrix and quantizations created from https://huggingface.co/unsloth/phi-4-GGUF/phi-4-F16.gguf

Imatrix dataset from [bartowski1182](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)

## [llama.cpp](https://github.com/ggerganov/llama.cpp) quants

```
phi-4-IQ2_S.gguf
phi-4-IQ3_XS.gguf
phi-4-Q4_K_M.gguf
phi-4-IQ4_XS.gguf
phi-4-IQ4_NL.gguf
```

## [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp) new quants

```
phi-4-IQ4_KS.gguf
phi-4-IQ4_NL_R4.gguf
```

## Credits
llama.cpp, ik_llama.cpp, bartowski, microsoft, unsloth, huggingface