File size: 590 Bytes
d3cd765 1b007a8 d3cd765 2dc8f33 d3cd765 ce97928 f3011f5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
license: mit
language:
- en
base_model:
- microsoft/phi-4-gguf
pipeline_tag: text-generation
tags:
- phi4
- gguf-connector
---
# gguf quantized and bug fixed version of phi4
## review
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed" in this version
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
## reference
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector/)|[reop](https://github.com/calcuis/gguf-connector)) |