Short Review of SFW/NSFW experience using this model
#2
by
GlobalMeltdown
- opened
So, I was really curious about this as it's been a long time since Pygmalion has dropped a model.
I tested this for SFW RP and NSFW RP:
Issues:
- Confuses roles and genders
- Doesn't understand relationships consistently
- Hesitates under sexual situations stuttering and repeating
- Often gets stuck in loops repeating itself
- Has problems following formatting even if instructed, whether context/instruct template or system prompt instructs it to do a certain format of responses for example "For dialogue" for actions/thoughts
- Lacks NSFW training data
- Continuity in group chats leads to role/character/confusion - doesn't even form sentences properly
Good things:
- Nice change of pace compared to other models/vocabulary and personality of characters
- Seems neutral in regard to most topics even if hesitant
- Lacks NSFW training data (good if looking for SFW RP)
Considering the behavior of this model, I believe there was something that went wrong in training because even a censored model usually doesn't have this much trouble keeping track of things.
Assuming they refine it in future iterations it might be amazing but as it currently stands, I cannot recommend it. But I look forward to seeing what else they might do.
It's a shame because it shows a lot of promise.