Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,8 @@ tags:
|
|
16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
18 |
|
|
|
|
|
|
|
19 |
## reference
|
20 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|
21 |
-
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector/)|[reop](https://github.com/calcuis/gguf-connector))
|
|
|
16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
18 |
|
19 |
+
## how to run it
|
20 |
+
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
21 |
+
|
22 |
## reference
|
23 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|
|