quantflex commited on
Commit
a0efcae
·
verified ·
1 Parent(s): 98952d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -21,4 +21,4 @@ Quants by: [quantflex](https://huggingface.co/quantflex)
21
 
22
  Run with [llama.cpp](https://github.com/ggerganov/llama.cpp):
23
 
24
- ```./llama-cli -m SmallThinker-3B-Preview-abliterated-F32-Q5_K_M.gguf -p 'You are a helpful assistant.' --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.1 -cnv --chat-template chatml```
 
21
 
22
  Run with [llama.cpp](https://github.com/ggerganov/llama.cpp):
23
 
24
+ ```./llama-cli -m SmallThinker-3B-Preview-abliterated-Q5_K_M.gguf -p 'You are a helpful assistant.' --temp 0.7 --top-p 0.8 --top-k 20 --repeat-penalty 1.1 -cnv --chat-template chatml```