Update README.md
Browse files
README.md
CHANGED
|
@@ -19,4 +19,6 @@ Model by: [huihui-ai](https://huggingface.co/huihui-ai) (thank you!)
|
|
| 19 |
Quants by: [quantflex](https://huggingface.co/quantflex)
|
| 20 |
|
| 21 |
|
| 22 |
-
Run with [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
|
|
|
|
|
|
|
|
| 19 |
Quants by: [quantflex](https://huggingface.co/quantflex)
|
| 20 |
|
| 21 |
|
| 22 |
+
Run with [llama.cpp](https://github.com/ggerganov/llama.cpp):
|
| 23 |
+
|
| 24 |
+
```./llama-cli -m SmallThinker-3B-Preview-abliterated-F32-Q5_K_M.gguf -p 'You are a helpful assistant.' --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.1 -cnv --chat-template chatml```
|