Update README.md
Browse files
README.md
CHANGED
@@ -28,6 +28,22 @@ These files are GPTQ 4bit model files for [HuggingFaceH4's Starchat Beta](https:
|
|
28 |
|
29 |
It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
## Repositories available
|
32 |
|
33 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starchat-beta-GPTQ)
|
|
|
28 |
|
29 |
It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
30 |
|
31 |
+
## Prompt template
|
32 |
+
|
33 |
+
```
|
34 |
+
<|system|> system message goes here <|end|>
|
35 |
+
<|user|> prompt goes here <|end|>
|
36 |
+
<|assistant|>
|
37 |
+
```
|
38 |
+
|
39 |
+
Example:
|
40 |
+
|
41 |
+
```
|
42 |
+
<|system|> Below is a conversation between a human user and a helpful AI coding assistant. <|end|>
|
43 |
+
<|user|> How do I sort a list in Python? <|end|>
|
44 |
+
<|assistant|>
|
45 |
+
```
|
46 |
+
|
47 |
## Repositories available
|
48 |
|
49 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starchat-beta-GPTQ)
|