chat_template.json is missing
When loading the model, I get error:
WARNING: TemplateLoadError: Model JSON path "/mnt/neuro/text-generation-webui/models/c4ai-command-a-03-2025-exl2-4.5bpw-262144seq/chat_template.json" not found.
Needless to say, without exact matching chat template the model does not work well. However, I did not find chat_template.json in the official model card either. Without it, not sure how to test the model. If someone created it successfully, please share
I was able to extract Command A chat template from transformers, seems to work:
https://dragon.studio/2025/03/chat_template.json
It can write some python scripts or some short stories. I did not test it throughly yet. But I noticed that it works better in the Chat Completion mode with its chat template. Using highly customized Text Completion with my own prompt makes it worse, like failing finish the message with EOS token and starting talking to itself. It seems to be very sensitive to chat template. I have no doubt its chat template can be customized and adapted, but it is necessary to be very careful with it.
I suggest testing it with the default template first to make sure it is working correctly. For me, it seems to work as far as I can tell. I think this quant is good.
Chat templates are typically defined in the tokenizer_config.json file for many models, near the end. In this case, you can find it on line 336.