Update README.md
Browse files
README.md
CHANGED
@@ -21,4 +21,4 @@ Quants by: [quantflex](https://huggingface.co/quantflex)
|
|
21 |
|
22 |
Run with [llama.cpp](https://github.com/ggerganov/llama.cpp):
|
23 |
|
24 |
-
```./llama-cli -m SmallThinker-3B-Preview-abliterated-
|
|
|
21 |
|
22 |
Run with [llama.cpp](https://github.com/ggerganov/llama.cpp):
|
23 |
|
24 |
+
```./llama-cli -m SmallThinker-3B-Preview-abliterated-Q5_K_M.gguf -p 'You are a helpful assistant.' --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.1 -cnv --chat-template chatml```
|