Plans for doing the 70B as well?
#2
by
Doctor-Shotgun
- opened
I've been enjoying the 70B instruct abliterated - any plans on doing the expanded dataset abliteration for the larger model as well?
Very interested in doing so, but considering it's quite costly for me to do given I ideally need to perform the abliteration on a non-quant version, I want to refine out some quirks noticeable in the 8B first; particularly hallucinations. Once I feel the methodology is just a bit more refined on the 8B, I'm very open to doing 70B.