Xin Liu
commited on
Commit
•
1fe00d4
1
Parent(s):
e7bb2fc
Update
Browse filesSigned-off-by: Xin Liu <[email protected]>
README.md
CHANGED
@@ -54,7 +54,7 @@ quantized_by: Second State Inc.
|
|
54 |
- Run as LlamaEdge service
|
55 |
|
56 |
```bash
|
57 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Meta-Llama-3-8B-Instruct
|
58 |
llama-api-server.wasm \
|
59 |
--prompt-template llama-3-chat \
|
60 |
--context-size 4096 \
|
|
|
54 |
- Run as LlamaEdge service
|
55 |
|
56 |
```bash
|
57 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Meta-Llama-3-8B-Instruct-Q5_K_M.gguf \
|
58 |
llama-api-server.wasm \
|
59 |
--prompt-template llama-3-chat \
|
60 |
--context-size 4096 \
|