Hugging Face's logo

legraphista
/
Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
Qwen2.5-0.5B-Instruct-IMat-GGUF / .gitattributes

Commit History

Upload Qwen2.5-0.5B-Instruct.IQ1_S.gguf with huggingface_hub
d7b8ca6
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ1_M.gguf with huggingface_hub
a20c2ff
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ2_XXS.gguf with huggingface_hub
f5fa113
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ2_XS.gguf with huggingface_hub
3aea391
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ2_S.gguf with huggingface_hub
c16909e
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ2_M.gguf with huggingface_hub
62f748e
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ3_XXS.gguf with huggingface_hub
a5d0b8b
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ3_XS.gguf with huggingface_hub
c119b82
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ3_S.gguf with huggingface_hub
5d52a3e
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ3_M.gguf with huggingface_hub
032f4c5
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ4_XS.gguf with huggingface_hub
41dc144
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.IQ4_NL.gguf with huggingface_hub
fce423d
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q2_K_S.gguf with huggingface_hub
9e608af
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q3_K_S.gguf with huggingface_hub
c2c9eaa
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q3_K_L.gguf with huggingface_hub
4284c52
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q4_K_S.gguf with huggingface_hub
ce43c7e
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q2_K.gguf with huggingface_hub
f92c2e9
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q3_K.gguf with huggingface_hub
e3236a0
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.BF16.gguf with huggingface_hub
4d50cf2
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q4_K.gguf with huggingface_hub
6d9d851
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.FP16.gguf with huggingface_hub
d393655
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q5_K_S.gguf with huggingface_hub
3c12591
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q5_K.gguf with huggingface_hub
4890abf
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q8_0.gguf with huggingface_hub
bc81176
verified

legraphista commited on

Upload Qwen2.5-0.5B-Instruct.Q6_K.gguf with huggingface_hub
35f1d8e
verified

legraphista commited on

initial commit
72507c1
verified

legraphista commited on