Update README.md
Browse files
README.md
CHANGED
@@ -11,6 +11,14 @@ tags:
|
|
11 |
This model was converted to GGUF format from [`sh2orc/Llama-3.1-Korean-8B-Instruct`](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
12 |
Refer to the [original model card](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) for more details on the model.
|
13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
## Use with llama.cpp
|
15 |
Install llama.cpp through brew (works on Mac and Linux)
|
16 |
|
|
|
11 |
This model was converted to GGUF format from [`sh2orc/Llama-3.1-Korean-8B-Instruct`](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
12 |
Refer to the [original model card](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) for more details on the model.
|
13 |
|
14 |
+
## Use with ollama
|
15 |
+
Create the model in Ollama
|
16 |
+
|
17 |
+
```bash
|
18 |
+
ollama create Llama-3.1-Korean-8B-Instruct-Q4_K_M -f Modelfile
|
19 |
+
|
20 |
+
```
|
21 |
+
|
22 |
## Use with llama.cpp
|
23 |
Install llama.cpp through brew (works on Mac and Linux)
|
24 |
|