cattoroboto
/

Qwen2-0.5B-Instruct-GGUF-Q2_K

Inference Endpoints

Model card Files Files and versions Community

Qwen2-0.5B-Instruct-GGUF-Q2_K / README.md

cattoroboto's picture

Upload 2 files

32bda14 verified 5 months ago

|

history blame contribute delete

355 Bytes

metadata

base_model: Qwen/Qwen2-0.5B-Instruct

smol

GGUF Quants of Qwen/Qwen2-0.5B-Instruct

Built with llama.cpp using this version

There is an official GGUF quant, but it was missing the Q2_K quant.