redhat6 commited on
Commit
db120e8
·
verified ·
1 Parent(s): 985a90d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -11,6 +11,14 @@ tags:
11
  This model was converted to GGUF format from [`sh2orc/Llama-3.1-Korean-8B-Instruct`](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
12
  Refer to the [original model card](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) for more details on the model.
13
 
 
 
 
 
 
 
 
 
14
  ## Use with llama.cpp
15
  Install llama.cpp through brew (works on Mac and Linux)
16
 
 
11
  This model was converted to GGUF format from [`sh2orc/Llama-3.1-Korean-8B-Instruct`](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
12
  Refer to the [original model card](https://huggingface.co/sh2orc/Llama-3.1-Korean-8B-Instruct) for more details on the model.
13
 
14
+ ## Use with ollama
15
+ Create the model in Ollama
16
+
17
+ ```bash
18
+ ollama create Llama-3.1-Korean-8B-Instruct-Q4_K_M -f Modelfile
19
+
20
+ ```
21
+
22
  ## Use with llama.cpp
23
  Install llama.cpp through brew (works on Mac and Linux)
24