fuzzy-mittenz
commited on
Update README.md
Browse files![white rabbit2.png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/d5TsSZidKTr36bnVPOgZO.png)
README.md
CHANGED
@@ -18,10 +18,15 @@ datasets:
|
|
18 |
---
|
19 |
|
20 |
# TEST
|
21 |
-
#
|
22 |
-
This model was converted to GGUF format using "THE_KEY" dataset for importace matrix Qantization from [`WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B`](https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
23 |
Refer to the [original model card](https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B) for more details on the model.
|
24 |
|
|
|
|
|
|
|
|
|
|
|
25 |
## Use with llama.cpp
|
26 |
Install llama.cpp through brew (works on Mac and Linux)
|
27 |
|
|
|
18 |
---
|
19 |
|
20 |
# TEST
|
21 |
+
# IntelligentEstate/ReasoningRabbit_Q2.5-Cd-7B-IQ4_XS-GGUF
|
22 |
+
This model is primarily for use with GPT4ALL and has reasoning capabilities similar to QwQ/o1/03 it was converted to GGUF format using "THE_KEY" dataset for importace matrix Qantization from [`WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B`](https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
23 |
Refer to the [original model card](https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B) for more details on the model.
|
24 |
|
25 |
+
|
26 |
+
![white rabbit2.png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/d5TsSZidKTr36bnVPOgZO.png)
|
27 |
+
# Using with GPT4ALL
|
28 |
+
after installing GPT4ALL from Nomic download their Reasoner v1 model and familiarize yourself with it, find the storage location under settings and place(only) this GGUF file in the same file as reasoner v1 apply the Jinja template in the "Jinja reasoner" file as well as the chat message above the template adjusting as needed. Enjoy
|
29 |
+
|
30 |
## Use with llama.cpp
|
31 |
Install llama.cpp through brew (works on Mac and Linux)
|
32 |
|