| - **bits**: 4 | |
| - **group_size**: 128 | |
| - **desc_act**: true | |
| - **static_groups**: false | |
| - **sym**: true | |
| - **lm_head**: false | |
| - **damp_percent**: 0.01 | |
| - **true_sequential**: true | |
| - **model_name_or_path**: "" | |
| - **model_file_base_name**: "model" | |
| - **quant_method**: "gptq" | |
| - **checkpoint_format**: "gptq" | |
| - **meta**: | |
| - **quantizer**: "gptqmodel:0.9.5" | |