Update README.md
Browse files
README.md
CHANGED
@@ -134,7 +134,7 @@ pip3 install hf_transfer
|
|
134 |
And set environment variable `HF_HUB_ENABLE_HF_TRANSFER` to `1`:
|
135 |
|
136 |
```shell
|
137 |
-
HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download TheBloke/Mixtral-8x7B-v0.1-GGUF mixtral-8x7b-v0.1.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False
|
138 |
```
|
139 |
|
140 |
Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
|
@@ -147,7 +147,7 @@ Windows Command Line users: You can set the environment variable by running `set
|
|
147 |
Make sure you are using `llama.cpp` from [PR 4406](https://github.com/ggerganov/llama.cpp/pull/4406)
|
148 |
|
149 |
```shell
|
150 |
-
./main -ngl 35 -m mixtral-8x7b-v0.1.Q4_K_M.gguf --color -c 32768 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "{prompt}"
|
151 |
```
|
152 |
|
153 |
Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|
|
|
134 |
And set environment variable `HF_HUB_ENABLE_HF_TRANSFER` to `1`:
|
135 |
|
136 |
```shell
|
137 |
+
HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False
|
138 |
```
|
139 |
|
140 |
Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
|
|
|
147 |
Make sure you are using `llama.cpp` from [PR 4406](https://github.com/ggerganov/llama.cpp/pull/4406)
|
148 |
|
149 |
```shell
|
150 |
+
./main -ngl 35 -m mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf --color -c 32768 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "{prompt}"
|
151 |
```
|
152 |
|
153 |
Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|