---
license: mit
language:
- en
base_model:
- microsoft/phi-4-gguf
pipeline_tag: text-generation
tags:
- phi4
- gguf-connector
---

# gguf quantized and bug fixed version of phi4

## review
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed" in this version
- tq1_0 and tq2_0 are not usable; should at least start with q2_k

## reference
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector/)|[reop](https://github.com/calcuis/gguf-connector))