datatab
/

YugoGPT-Quantized-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

YugoGPT-Quantized-GGUF / YugoGPT-Quantized.GGUF.Q3_K_L.gguf

Commit History

q3_k_l: Uses Q5_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K

6cc55a8
verified

datatab commited on Feb 26