GGUF
Composer
MosaicML
llm-foundry

Can't launch model

#1
by nikich340 - opened

Can't use this model with Transformers method in text-generation-webui.

File "C:\AI\text-generation-webui\installer_files\env\Lib\site-packages\transformers\models\auto\configuration_auto.py", line 1034, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\AI\text-generation-webui\installer_files\env\Lib\site-packages\transformers\configuration_utils.py", line 620, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\AI\text-generation-webui\installer_files\env\Lib\site-packages\transformers\configuration_utils.py", line 708, in _get_config_dict
raise EnvironmentError(
OSError: It looks like the config file at 'models\mosaicml-mpt-7b-8k-chat-Q6_K.gguf' is not a valid JSON file.

Sign up or log in to comment