4-bit GPTQ quantized version of Qwen2.5-Coder-32B-Instruct for use with the Private LLM app.

Downloads last month
0
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for numen-tech/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Base model

Qwen/Qwen2.5-32B
Quantized
(98)
this model

Collection including numen-tech/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4