Zenabius
/

Qwen2.5-Coder-3B-Instruct-exl2

8-bit precision

Model card Files Files and versions Community

Qwen2.5-Coder-3B-Instruct-exl2 / README.md

Zenabius's picture

Update README.md

17e598a verified 4 months ago

|

history blame contribute delete

243 Bytes

metadata

base_model:
  - Qwen/Qwen2.5-Coder-3B-Instruct

EXL2 Quantizations of Qwen2.5-Coder-3B-Instruct

Using exllamav2 release 0.2.5 for quantization.

Original model: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct

Bits 8.0, lm_head 8.0