Alignment-Lab-AI
commited on
Commit
·
3e49e6f
1
Parent(s):
8876aa6
Update README.md
Browse files
README.md
CHANGED
@@ -47,6 +47,33 @@ We will also give sneak-peak announcements on our Discord, which you can find he
|
|
47 |
|
48 |
https://AlignmentLab.ai
|
49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
50 |
|
51 |
# Evaluation
|
52 |
|
@@ -112,35 +139,6 @@ Commodity cost was ~$600.
|
|
112 |
Please await our full releases for further training details.
|
113 |
|
114 |
|
115 |
-
# Prompt Template
|
116 |
-
|
117 |
-
We use our own prompt template which we call "`OpenChat Llama2 V1`"
|
118 |
-
|
119 |
-
|
120 |
-
Examples:
|
121 |
-
```
|
122 |
-
# Single-turn V1 Llama 2
|
123 |
-
tokenize("User: Hello<|end_of_turn|>Assistant:")
|
124 |
-
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
|
125 |
-
|
126 |
-
# Multi-turn V1 Llama 2
|
127 |
-
tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
|
128 |
-
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
|
129 |
-
```
|
130 |
-
|
131 |
-
For UIs with Prefix and Suffix fields, these will likely work:
|
132 |
-
|
133 |
-
Prefix (include a space after colon):
|
134 |
-
```
|
135 |
-
User:
|
136 |
-
```
|
137 |
-
|
138 |
-
Suffix (space after colon):
|
139 |
-
```
|
140 |
-
<|end_of_turn|>\nAssistant:
|
141 |
-
```
|
142 |
-
|
143 |
-
|
144 |
# Serving
|
145 |
|
146 |
This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.
|
|
|
47 |
|
48 |
https://AlignmentLab.ai
|
49 |
|
50 |
+
# Prompt Template
|
51 |
+
|
52 |
+
We use our own prompt template which we call "`OpenChat Llama2 V1`"
|
53 |
+
|
54 |
+
|
55 |
+
Examples:
|
56 |
+
```
|
57 |
+
# Single-turn V1 Llama 2
|
58 |
+
tokenize("User: Hello<|end_of_turn|>Assistant:")
|
59 |
+
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
|
60 |
+
|
61 |
+
# Multi-turn V1 Llama 2
|
62 |
+
tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
|
63 |
+
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
|
64 |
+
```
|
65 |
+
|
66 |
+
For UIs with Prefix and Suffix fields, these will likely work:
|
67 |
+
|
68 |
+
Prefix (include a space after colon):
|
69 |
+
```
|
70 |
+
User:
|
71 |
+
```
|
72 |
+
|
73 |
+
Suffix (space after colon):
|
74 |
+
```
|
75 |
+
<|end_of_turn|>\nAssistant:
|
76 |
+
```
|
77 |
|
78 |
# Evaluation
|
79 |
|
|
|
139 |
Please await our full releases for further training details.
|
140 |
|
141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
142 |
# Serving
|
143 |
|
144 |
This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.
|