Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
TheBloke commited on
Commit
71358ec
1 Parent(s): cbfc3db

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -29,6 +29,31 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
29
  * [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/orca_mini_13B-GGML)
30
  * [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/psmathur/orca_mini_13b)
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## How to easily download and use this model in text-generation-webui
33
 
34
  Please make sure you're using the latest version of text-generation-webui
 
29
  * [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/orca_mini_13B-GGML)
30
  * [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/psmathur/orca_mini_13b)
31
 
32
+ ## Prompt template: Alpaca with system message
33
+
34
+ ```
35
+ ### System:
36
+ You are an AI assistant that follows instruction extremely well. Help as much as you can.
37
+
38
+ ### User:
39
+ prompt
40
+
41
+ ### Response
42
+ ```
43
+ or
44
+ ```
45
+ ### System:
46
+ You are an AI assistant that follows instruction extremely well. Help as much as you can.
47
+
48
+ ### User:
49
+ prompt
50
+
51
+ ### Input
52
+ input
53
+
54
+ ### Response
55
+ ```
56
+
57
  ## How to easily download and use this model in text-generation-webui
58
 
59
  Please make sure you're using the latest version of text-generation-webui