Update README.md
Browse files
README.md
CHANGED
@@ -26,48 +26,25 @@ language:
|
|
26 |
|
27 |
[haqishen/Llama-3-8B-Japanese-Instruct](https://huggingface.co/haqishen/Llama-3-8B-Japanese-Instruct)
|
28 |
|
29 |
-
## Run with LlamaEdge
|
30 |
|
31 |
-
|
32 |
|
33 |
-
|
34 |
|
35 |
-
|
36 |
|
37 |
-
|
38 |
|
39 |
-
|
40 |
-
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
41 |
|
42 |
-
{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
43 |
|
44 |
-
|
45 |
|
46 |
-
|
47 |
|
48 |
-
|
49 |
-
```
|
50 |
|
51 |
-
- Context size: `4096`
|
52 |
|
53 |
-
- Run as LlamaEdge service
|
54 |
-
|
55 |
-
```bash
|
56 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Llama-3-8B-Japanese-Instruct-Q5_K_M.gguf \
|
57 |
-
llama-api-server.wasm \
|
58 |
-
--prompt-template llama-3-chat \
|
59 |
-
--ctx-size 4096 \
|
60 |
-
--model-name Llama-3-8B-Japanese-Instruct \
|
61 |
-
```
|
62 |
-
|
63 |
-
- Run as LlamaEdge command app
|
64 |
-
|
65 |
-
```bash
|
66 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Llama-3-8B-Japanese-Instruct-Q5_K_M.gguf \
|
67 |
-
llama-chat.wasm \
|
68 |
-
--prompt-template llama-3-chat \
|
69 |
-
--ctx-size 4096
|
70 |
-
```
|
71 |
|
72 |
## Quantized GGUF Models
|
73 |
|
|
|
26 |
|
27 |
[haqishen/Llama-3-8B-Japanese-Instruct](https://huggingface.co/haqishen/Llama-3-8B-Japanese-Instruct)
|
28 |
|
|
|
29 |
|
30 |
+
## Run with Gaianet
|
31 |
|
32 |
+
**Prompt template:**
|
33 |
|
34 |
+
prompt template: `llama-3-chat`
|
35 |
|
36 |
+
**Context size:**
|
37 |
|
38 |
+
chat_ctx_size: `4096`
|
|
|
39 |
|
|
|
40 |
|
41 |
+
**Run with GaiaNet:**
|
42 |
|
43 |
+
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
|
44 |
|
45 |
+
- Customize your node: https://docs.gaianet.ai/node-guide/customize
|
|
|
46 |
|
|
|
47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
48 |
|
49 |
## Quantized GGUF Models
|
50 |
|