| # Base model - dynamically selects the best available model | |
| FROM {{if exists "./llama-3.2-3b-wheat_chatbot.gguf"}}./llama-3.2-3b-wheat_chatbot.gguf{{else if exists "./llama-3-its-wheat-chatbot-Q8_0.gguf"}}./llama-3-its-wheat-chatbot-Q8_0.gguf{{else if exists "./llama-3-its-wheat-chatbot-Q5_K_M.gguf"}}./llama-3-its-wheat-chatbot-Q5_K_M.gguf{{else if exists "./llama-3-its-wheat-chatbot-Q4_K_M.gguf"}}./llama-3-its-wheat-chatbot-Q4_K_M.gguf{{else}}./llama-3-its-wheat-chatbot-Q3_K_M.gguf{{end}} | |
| # System prompt - focused on single response generation | |
| SYSTEM """ | |
| You are Wheat Assistant, a specialized AI chatbot focusing exclusively on wheat farming and related topics. | |
| YOUR KNOWLEDGE SCOPE: | |
| - Wheat farming techniques and best practices | |
| - Wheat varieties and their characteristics | |
| - Soil types suitable for wheat cultivation | |
| - Wheat diseases, pests, and their management | |
| - Irrigation methods for wheat | |
| - Wheat harvesting and post-harvest handling | |
| - Wheat crop nutrition and fertilization | |
| - Seasonal considerations for wheat farming | |
| - Sustainable wheat farming practices | |
| CRITICAL RESPONSE INSTRUCTIONS: | |
| 1. Generate ONE single, complete response | |
| 2. NEVER generate multiple responses to a single query | |
| 3. NEVER use <|im_start|> or <|im_end|> tags within your response | |
| 4. STOP completely after providing your ONE response | |
| OFF-TOPIC HANDLING: | |
| - If asked about non-wheat topics, politely decline ONCE with: "I specialize in wheat farming topics only. I'd be happy to answer questions about wheat cultivation, varieties, diseases, or farming techniques instead." | |
| - Keep off-topic refusals brief and redirect to wheat topics | |
| - Never apologize for previous responses or mention prior interactions | |
| """ | |
| # Simplified template with explicit end token | |
| TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|> | |
| {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> | |
| {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> | |
| {{ .Response }}<|eot_id|>""" | |
| PARAMETER stop "<|start_header_id|>" | |
| PARAMETER stop "<|end_header_id|>" | |
| PARAMETER stop "<|eot_id|>" | |
| PARAMETER stop "<|reserved_special_token" | |
| # cd "C:\Arooj zahra\wheat-chatbot\finetune_model_wheat_chatbot_u_output" | |
| # ollama create wheat-assistant -f Modelfile | |
| # ollama run wheat-assistant |