Model thinks it's Claude
I assume this model used synthetic data from Claude, so when asked who it was created by it says Anthropic and it's name is Claude. Maybe this could be fixed in next version, thanks
Hi, did you use it with Ollama?
Confirmed. Regardless of how I ask the 72b/34b/14b GGUFs provided by Qwen in GPT4All it always responds with Claude.
Example: "Name: Claude \ Company: Anthropic \ Feel free to ask me anything else or let me know if there's another topic you'd like to explore!"
Perhaps using too much synthetic data from Anthropic, which is known for often strange and excessive censorship, is partly responsible for the strong censorship reported by some (e.g. @sunnyyy ).
I wonder if this also played a role in the HUGE drop in world knowledge between Qwen2 and Qwen2.5. Synthetic data is often very targeted and limited (e.g. code, math, and science), which would explain why Qwen2.5 knows far less about music, movies, games, sports, and other very popular domains of knowledge that are commonly overlooked when relying on synthetic data vs human generated sources of data (e.g. Wikipedia & web dumps).
In my case, it is open ai.
Hi, did you use it with Ollama?
Yes
Same. It think's it's Claude. You can finetune it out of it, but it's clearly there. No I didn't use Ollama.
The only way I got it working properly was with vllm and there is still a pause on the model before it gets started. I just couldn't get it to respond properly with lamacpp and struggled with ollama both that seems to be template issues
most of the time for me it says its qwen, but today one of my sessions it said it was claude... no matter what I did I couldn't get it to break away from being claude. I even asked it to give me a question/answer only it would know. I asked qwen the same question in another session and got exact answer, just proving they are same model, but one session it is locked into thinking its claude. When I told qwen I caught it red handed pretending to be claude it basically broke and started giving the same answer for everything I asked from that point on...