NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Quantized GGUF model files for LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3 from NickyNicky

Name	Quant method	Size
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.fp16.gguf	fp16	496.82 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q2_k.gguf	q2_k	105.46 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_xs.gguf	q3_k_xs	115.32 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_m.gguf	q3_k_m	129.03 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q4_k_m.gguf	q4_k_m	155.67 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q5_k_m.gguf	q5_k_m	179.23 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q6_k.gguf	q6_k	204.26 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q8_0.gguf	q8_0	264.33 MB

Original Model Card: