numen-tech
/

Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-GPTQ-Int4 / config.json

numen-tech's picture

Add weights

f54fa87 24 days ago

history blame contribute delete

55 Bytes

	{
	"quantization_config": {
	"bits": 4
	}
	}