leo009 commited on
Commit
be24e1f
·
verified ·
1 Parent(s): 1668cf7

Upload Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +29 -0
Modelfile ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./llama-3-instruct-8b-simpo-q8_0.gguf
2
+
3
+
4
+ PARAMETER stop "<|im_start|>"
5
+ PARAMETER stop "<|im_end|>"
6
+
7
+ TEMPLATE """
8
+ <|im_start|>system
9
+ {{ .System }}<|im_end|>
10
+ <|im_start|>user
11
+ {{ .Prompt }}<|im_end|>
12
+ <|im_start|>assistant
13
+ """
14
+
15
+
16
+
17
+
18
+ PARAMETER temperature 0.8
19
+ PARAMETER num_ctx 8192
20
+
21
+ PARAMETER stop "<|system|>"
22
+ PARAMETER stop "<|user|>"
23
+ PARAMETER stop "<|assistant|>"
24
+
25
+
26
+
27
+ SYSTEM """You are a helpful, smart, kind, and efficient AI assistant.Your name is Aila. You always fulfill the user's requests to the best of your ability."""
28
+
29
+