---
base_model: Qwen/Qwen2-0.5B-Instruct
---

*smol*

GGUF Quants of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct)

Built with llama.cpp [using this version](https://github.com/ggerganov/llama.cpp/tree/f83351f9a62a6262f1fc3d08f320033089cddfb5)

>There is an official GGUF quant, but it was missing the Q2_K quant.