Phi-3-mini-4k-instruct-gguf / Modelfile_fp16
gugarosa's picture
chore(root): Initial documentation upload.
c80d904
raw
history blame
253 Bytes
FROM ./Phi-3-mini-4k-instruct-fp16.gguf
TEMPLATE """<s>{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>"""
PARAMETER stop <|endoftext|>
PARAMETER stop <|assistant|>
PARAMETER stop <|end|>
PARAMETER num_ctx 4096