Great model for storywriting
The dataset unslopping clearly worked because this model has a much more lively writing style than any other 12B tune I've tried. Can't speak about its RPing since I don't do that, I'm just autocompleting story prose in the Notebook in ooba, but it's doing great at that. Very nice work my friend.
Any chance you could share the full FP16 weights for use with Transformers?
Hey anxcat, thanks! What format are you using? Alpaca has the most influence for my storywriting sauce.
Btw, I've been playing with a partial tune: https://huggingface.co/BeaverAI/Behemoth-123B-v2a-GGUF and I might release it as a story model. Try it out!
RE: FP16, I'll release it when I release Rocinante v2.
No formatting at all, just raw autocomplete in the Notebook, basically treating it like it's a base model. With some instruct models you get assistant-style stuff leaking in when you use them the 'wrong' way like that, but most actually work fine (this one does too).
My impressions of this model are very positive.
Pros:
- Not aggressive in harassing the user. You can easily play 60+ posts on this model without LLM trying to get in the user's underpants.
- Holds character personality and understands the prompts well.
- Writes exactly the right amount of narrative without an excess or conversely lack of context.
- Very pleasant literary language, with a minimum of GPTism.
Minuses:
- Often likes to describe the user's actions, taking on the user's role.
- Very high percentage of positive attitude towards the user. (Even a character who hates you will confess love if pressed properly).
- LLM is sometimes confused about the setting, actions, and items previously mentioned in the RP.
- Some repetition of actions is noticeable, especially when the model doesn't know where to lead the RP next.
Of the recent MN-based models I've tested, this is probably one of the best, along with NemoMix-Unleashed-12B, Violet_Twilight-v0.2 and Mistral-Nemo-12B-ArliAI-RPMax-v1.2. It's just hard to RP with high horny models, although they can be a lot of fun.