Problem with the prompt template
#1
by
Shards86
- opened
Hi,
I was testing out Ahma with ollama as it is straight out of box, without further finetuning.
For some reason I always get [/INST] marker in model's output when using instructed llama2 prompt template:
" [INST] << SYS >>
{{ .System }}
<</ SYS >>
{{ .Prompt }} [/INST] "
If you could be able to point out or suggest what I am doing wrong, I would be grateful. Thanks!
I close this topic now, for future reference this is discussed here: https://huggingface.co/mradermacher/Ahma-3B-Instruct-GGUF/discussions/1
Shards86
changed discussion status to
closed