mosaicml-mpt-30b-chat-w4-g128-awq / quantize_config.json
abhinavkulkarni's picture
Upload config
51588d4
raw
history blame contribute delete
58 Bytes
{
"bits": 4,
"group_size": 128,
"zero_point": true
}