Hugging Face's logo

datatab
/
YugoGPT-Quantized-GGUF

Transformers
GGUF
Serbian
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
datatab commited on
Commit
6458855
•
1 Parent(s): 6cc55a8

q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. YugoGPT-Quantized-GGUF.Q3_K_M.gguf → YugoGPT-Quantized.GGUF.Q3_K_M.gguf +0 -0
.gitattributes CHANGED
@@ -61,3 +61,4 @@ YugoGPT-Quantized-GGUF-unsloth.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
61
  YugoGPT-Quantized-GGUF.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
62
  YugoGPT-Quantized.GGUF.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
63
  YugoGPT-Quantized.GGUF.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 
 
61
  YugoGPT-Quantized-GGUF.Q3_K_XS.gguf filter=lfs diff=lfs merge=lfs -text
62
  YugoGPT-Quantized.GGUF.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
63
  YugoGPT-Quantized.GGUF.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
64
+ YugoGPT-Quantized.GGUF.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
YugoGPT-Quantized-GGUF.Q3_K_M.gguf → YugoGPT-Quantized.GGUF.Q3_K_M.gguf RENAMED
File without changes