README.md

metadata

license: mit
language:
  - en
base_model:
  - microsoft/phi-4-gguf
pipeline_tag: text-generation
tags:
  - phi4
  - gguf-connector

gguf quantized and bug fixed version of phi4

review

• bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed" in this version
• tq1_0 and tq2_0 are not usable; seems at least should start with q2_k

reference

• base model: microsoft/phi-4
• gguf-connector (pypi|reop)