---
license: mit
language:
- en
base_model:
- microsoft/phi-4-gguf
pipeline_tag: text-generation
tags:
- phi4
- gguf-connector
---

## gguf quantized and bug fixed version of phi4

### review
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k

### how to run it
use any connector for interacting with gguf file, i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)

### reference
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)