Update README.md

README.md

@@ -16,46 +16,34 @@ model_creator: LakoMoor
 model_type: mistral
 ---
 
-# woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF
+# woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF-Imatrix
 This model was converted to GGUF format from [`LakoMoor/Silicon-Alice-7B`](https://huggingface.co/LakoMoor/Silicon-Alice-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/LakoMoor/Silicon-Alice-7B) for more details on the model.
 
-## Use with llama.cpp
-Install llama.cpp through brew (works on Mac and Linux)
+![Silicon-Alice-7B](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/alice.png)
 
-```bash
-brew install llama.cpp
+## What's that?
 
-```
-Invoke the llama.cpp server or the CLI.
+Silicon-Alice-7B-GGUF is a quantized model based on [Silicon-Masha-7B](https://huggingface.co/LakoMoor/Silicon-Alice-7B) aiming to be both strong in RP, be smart  **and** understand Russian, that can follow character maps very well. This model understands Russian better than the previous one. It is suitable for RP/ERP and general use. It can be run on weak samovar using [llama.cpp](https://github.com/ggerganov/llama.cpp) or [koboldcpp](https://github.com/LostRuins/koboldcpp).
 
-### CLI:
-```bash
-llama-cli --hf-repo woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF --hf-file silicon-alice-7b-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
-```
+## Prompt Template (Alpaca)
 
-### Server:
-```bash
-llama-server --hf-repo woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF --hf-file silicon-alice-7b-q5_k_m-imat.gguf -c 2048
-```
+I found the best SillyTavern results from using the Noromaid template but please try other templates! Let me know if you find anything good.
 
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
+SillyTavern config files: [Context](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/context.json), [Instruct](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/instruct.json).
 
-Step 1: Clone llama.cpp from GitHub.
-```
-git clone https://github.com/ggerganov/llama.cpp
-```
+Additionally, here is my highly recommended [Text Completion preset](https://huggingface.co/LakoMoor/Silicon-Alice-7B-GGUF/resolve/main/assets/MinP.json). You can tweak this by adjusting temperature up or dropping min p to boost creativity or raise min p to increase stability. You shouldn't need to touch anything else!
 
-Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
 ```
-cd llama.cpp && LLAMA_CURL=1 make
+Below is an instruction that describes a task. Write a response that appropriately completes the request.
+### Instruction:
+{prompt}
+### Response:
 ```
 
-Step 3: Run inference through the main binary.
-```
-./llama-cli --hf-repo woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF --hf-file silicon-alice-7b-q5_k_m-imat.gguf -p "The meaning to life and the universe is"
-```
-or 
-```
-./llama-server --hf-repo woofwolfy/Silicon-Alice-7B-Q5_K_M-GGUF --hf-file silicon-alice-7b-q5_k_m-imat.gguf -c 2048
+## How run it ?
+[llama.cpp](https://github.com/ggerganov/llama.cpp)
+```shell
+./main -ngl 35 -m silicon-alice-7b.Q4_K_M.gguf --color -c 32768 --temp 0.4 --repeat_penalty 1.1 -n -1 -p "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n{system_message}\n### Instruction:{prompt}\n### Response:\n"
 ```
+