Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Disclaimer: I don't know what I'm doing.

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for cshared/Qwen-QwQ-32B-3.75bpw-exl2

Base model

Qwen/Qwen2.5-32B

Finetuned

Quantized

(102)

this model

Collection including cshared/Qwen-QwQ-32B-3.75bpw-exl2