| library_name: peft | |
| ## Training procedure | |
| The following `bitsandbytes` quantization config was used during training: | |
| - bits: 4 | |
| - checkpoint_format: gptq | |
| - desc_act: True | |
| - dynamic: None | |
| - group_size: 128 | |
| - lm_head: False | |
| - meta: {'damp_auto_increment': 0.0015, 'damp_percent': 0.01, 'quantizer': ['gptqmodel:1.4.0-dev'], 'static_groups': False, 'true_sequential': True, 'uri': 'https://github.com/modelcloud/gptqmodel'} | |
| - quant_method: gptq | |
| - sym: True | |
| ### Framework versions | |
| - PEFT 0.5.0 | |