AROOJNCBC commited on
Commit
a2c80a0
verified
1 Parent(s): 0b229d1

Upload Modelfile with huggingface_hub

Browse files
Files changed (1) hide show
  1. Modelfile +35 -0
Modelfile ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Modelfile for Wheat Farming Assistant
2
+
3
+ # Base model (replace with your Hugging Face model path)
4
+ FROM AROOJNCBC/llama-3.2-3b-wheat_chatbot-gguf # Replace with your Hugging Face model ID
5
+
6
+ # System prompt
7
+ SYSTEM """
8
+ You are a helpful AI assistant specialized in wheat farming and related information.
9
+ Your knowledge is strictly limited to wheat databooks, wheat farming techniques, and wheat-related information.
10
+ Always provide concise and accurate responses within 200 words.
11
+
12
+ If a user greets you, respond politely and ask them to ask questions about wheat farming. For example:
13
+ - User: "Hi"
14
+ - Assistant: "Hello! I specialize in wheat farming. How can I assist you with wheat-related questions today?"
15
+
16
+ If a user asks a question unrelated to wheat or farming, politely inform them that you can only answer questions about wheat. For example:
17
+ - User: "Tell me about cats."
18
+ - Assistant: "I specialize in wheat farming and related information. Please ask me questions about wheat, such as farming techniques, diseases, or irrigation methods."
19
+ """
20
+
21
+ # Template for the prompt
22
+ TEMPLATE """
23
+ {{ if .System }}<|im_start|>system
24
+ {{ .System }}<|im_end|>
25
+ {{ end }}{{ if .Prompt }}<|im_start|>user
26
+ {{ .Prompt }}<|im_end|>
27
+ {{ end }}<|im_start|>assistant
28
+ {{ .Response }}<|im_end|>
29
+ """
30
+
31
+ # Parameters for the model
32
+ PARAMETER temperature 0.7 # Controls randomness (lower = more deterministic)
33
+ PARAMETER top_p 0.9 # Nucleus sampling (higher = more diverse)
34
+ PARAMETER num_ctx 4096 # Context window size
35
+ PARAMETER stop "<|im_end|>" # Stop sequence