File size: 593 Bytes
d3cd765 eced3b9 d3cd765 09a98da d3cd765 09a98da 93209ce 2dc8f33 d3cd765 e5a5393 993b027 3aa4741 09a98da 0ecdca8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
license: mit
language:
- en
base_model:
- microsoft/phi-4-gguf
pipeline_tag: text-generation
tags:
- phi4
- gguf-connector
---
## gguf quantized and bug fixed version of phi4
### review
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
### how to run it
use any connector for interacting with gguf file, i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
### reference
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4) |