alabulei commited on
Commit
c06381b
1 Parent(s): cef706c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -31
README.md CHANGED
@@ -26,48 +26,25 @@ language:
26
 
27
  [haqishen/Llama-3-8B-Japanese-Instruct](https://huggingface.co/haqishen/Llama-3-8B-Japanese-Instruct)
28
 
29
- ## Run with LlamaEdge
30
 
31
- - LlamaEdge version: [v0.10.1](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.10.1) and above
32
 
33
- - Prompt template
34
 
35
- - Prompt type: `llama-3-chat`
36
 
37
- - Prompt string
38
 
39
- ```text
40
- <|begin_of_text|><|start_header_id|>system<|end_header_id|>
41
 
42
- {{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>
43
 
44
- {{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
45
 
46
- {{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>
47
 
48
- {{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
49
- ```
50
 
51
- - Context size: `4096`
52
 
53
- - Run as LlamaEdge service
54
-
55
- ```bash
56
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Llama-3-8B-Japanese-Instruct-Q5_K_M.gguf \
57
- llama-api-server.wasm \
58
- --prompt-template llama-3-chat \
59
- --ctx-size 4096 \
60
- --model-name Llama-3-8B-Japanese-Instruct \
61
- ```
62
-
63
- - Run as LlamaEdge command app
64
-
65
- ```bash
66
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Llama-3-8B-Japanese-Instruct-Q5_K_M.gguf \
67
- llama-chat.wasm \
68
- --prompt-template llama-3-chat \
69
- --ctx-size 4096
70
- ```
71
 
72
  ## Quantized GGUF Models
73
 
 
26
 
27
  [haqishen/Llama-3-8B-Japanese-Instruct](https://huggingface.co/haqishen/Llama-3-8B-Japanese-Instruct)
28
 
 
29
 
30
+ ## Run with Gaianet
31
 
32
+ **Prompt template:**
33
 
34
+ prompt template: `llama-3-chat`
35
 
36
+ **Context size:**
37
 
38
+ chat_ctx_size: `4096`
 
39
 
 
40
 
41
+ **Run with GaiaNet:**
42
 
43
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
44
 
45
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
 
46
 
 
47
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
 
49
  ## Quantized GGUF Models
50