Update README.md
Browse files
README.md
CHANGED
@@ -57,7 +57,7 @@ Compiling on Windows: developer cmp-nct notes: 'I personally compile it using VS
|
|
57 |
|
58 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
59 |
```
|
60 |
-
bin/falcon_main -t 8 -ngl 100 -b 1 -m
|
61 |
```
|
62 |
|
63 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|
|
|
57 |
|
58 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
59 |
```
|
60 |
+
bin/falcon_main -t 8 -ngl 100 -b 1 -m falcon-40b-sft-mix-1226.ggccv1.q4_K.bin -p "What is a falcon?\n### Response:"
|
61 |
```
|
62 |
|
63 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|