danielhanchen commited on
Commit
aaffc4e
·
verified ·
1 Parent(s): f44860f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -43,13 +43,14 @@ Or you can view more detailed instructions here: [unsloth.ai/blog/deepseek-r1](h
43
  4. If you have a GPU (RTX 4090 for example) with 24GB, you can offload multiple layers to the GPU for faster processing. If you have multiple GPUs, you can probably offload more layers.
44
  ```bash
45
  ./llama.cpp/llama-cli \
46
- --model DeepSeek-R1-UD-IQ1_S/DeepSeek-R1-UD-IQ1_S-00001-of-00003.gguf \
47
- --cache-type-k q4_0 \
48
- --threads 12 -no-cnv --n-gpu-layers 7 --prio 2 \
49
- --temp 0.6 \
50
- --ctx-size 8192 \
51
- --seed 3407 \
52
- --prompt "<|User|>Create a Flappy Bird game in Python.<|Assistant|>"
 
53
  ```
54
  5. If you want to merge the weights together, use this script:
55
  ```
 
43
  4. If you have a GPU (RTX 4090 for example) with 24GB, you can offload multiple layers to the GPU for faster processing. If you have multiple GPUs, you can probably offload more layers.
44
  ```bash
45
  ./llama.cpp/llama-cli \
46
+ --model DeepSeek-R1-UD-IQ1_S/DeepSeek-R1-UD-IQ1_S-00001-of-00003.gguf \
47
+ --cache-type-k q4_0 \
48
+ --threads 12 -no-cnv --prio 2 \
49
+ --n-gpu-layers 7 \
50
+ --temp 0.6 \
51
+ --ctx-size 8192 \
52
+ --seed 3407 \
53
+ --prompt "<|User|>Create a Flappy Bird game in Python.<|Assistant|>"
54
  ```
55
  5. If you want to merge the weights together, use this script:
56
  ```