itsnebulalol
/

Llama-3.2-Nemotron-3B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

itsnebulalol commited on Oct 24

Commit

de6bf6d

•

1 Parent(s): 70abea6

(Trained with Unsloth)

Files changed (1) hide show

Modelfile +1 -1

Modelfile CHANGED Viewed

@@ -1,5 +1,5 @@
-FROM /home/dominic/itsnebulalol/Llama-3.2-Nemotron-3B-Instruct-GGUF/unsloth.BF16.gguf
 TEMPLATE """{{ if .System }}<|im_start|>system
 {{ .System }}<|im_end|>
 {{ end }}{{ if .Prompt }}<|im_start|>user

+FROM /home/dominic/itsnebulalol/Llama-3.2-Nemotron-3B-Instruct-GGUF/unsloth.Q8_0.gguf
 TEMPLATE """{{ if .System }}<|im_start|>system
 {{ .System }}<|im_end|>
 {{ end }}{{ if .Prompt }}<|im_start|>user