Update README.md
Browse files
README.md
CHANGED
@@ -4,6 +4,5 @@ license: llama2
|
|
4 |
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-7B
|
5 |
|
6 |
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
|
7 |
-
|
8 |
-
|
9 |
-
```
|
|
|
4 |
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-7B
|
5 |
|
6 |
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
|
7 |
+
|
8 |
+
`.\server.exe -m ".\models\ShareGPT4V-7B_Q5_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"`
|
|