NeverSleep

/

Noromaid-v0.1-mixtral-8x7b-v3

like 15

Follow

NeverSleep 386

The test team came up with the below settings as the best we could do. I don't think any of us are going to use this model as a daily driver, but here's what we did to salvage the model:

Samplers Preset (this is the only thing that worked at all):
https://files.catbox.moe/adpb5r.json
t=1.50, min.p=0.018, and it's not a terrible idea to add some tfs to take the edge off so I did that in this version of the file

Fixed Instruct Preset:
There was some wishful thinking junk in the existing preset that I removed, and some style guide stuff that shouldn't have been there (and would break lots of cards), and the model does MUCH better using mistral instruct than it does under Alpaca. I fixed that.
https://files.catbox.moe/bjibow.json

It's probably not a bad idea to fix your context template to have [INST] [/INST] around it, too. I'm not going to bother to make a preset for that, anyone can do that themselves.

Thanks, Undi!

Like I said in discord, this is the closest Noromaid to "usable" we've seen so far. Better than the non-instruct.