Spaces:

---

medmekk

/

TorchAO_Quantization

like 2

Sleeping

I get this error otherwise

  File "/home/marksaroufim/.conda/envs/nv/lib/python3.10/site-packages/transformers/quantizers/auto.py", line 198, in merge_quantization_configs
    quantization_config = AutoQuantizationConfig.from_dict(quantization_config)
  File "/home/marksaroufim/.conda/envs/nv/lib/python3.10/site-packages/transformers/quantizers/auto.py", line 128, in from_dict
    return target_cls.from_dict(quantization_config_dict)
  File "/home/marksaroufim/.conda/envs/nv/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 1647, in from_dict
    len(quant_type) == 1 and "default" in quant_type
AssertionError: Expected only one key 'default' in quant_type dictionary