|
--- |
|
license: cc-by-nc-4.0 |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
<p align="center"><font size="5"> <b>An interesting experiment. Give it a shot.</b></font></p> |
|
<p align="center"><font size="4"> <b>Seems to perfer Alpaca for instruct, and ChatML for storytelling.</b></font></p> |
|
<p align="center"><font size="6"> <b>4-bit Examples with Alpaca</b></font></p> |
|
<p align="center"><img src="https://iili.io/JzL3H9p.png"/> |
|
<p align="center"><font size="5"><b><a href="https://iili.io/JzLFH0b.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p> |
|
<p align="center"><font size="6"> <b>4-bit Examples with ChatML</b></font></p> |
|
<p align="center"><img src="https://iili.io/JzL2ySR.png"/> |
|
<p align="center"><font size="5"><b><a href="https://iili.io/JzsUNIt.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p> |
|
|
|
|
|
### Recipe |
|
merge_method: dare_ties |
|
|
|
- base_model: athirdpath/BigMistral-11b |
|
|
|
- model: athirdpath/NeuralPivot-11b |
|
|
|
weight: [0.50, 0.45, 0.30] / density: 0.30 |
|
|
|
- model: athirdpath/PianoMaid-11b |
|
|
|
weight: [0.22, 0.27, 0.42] / density: [0.55, 0.52, 0.35] |
|
|
|
- model: athirdpath/BigMistral-11b-GLUED |
|
|
|
weight: 0.28 / density: 0.30 |
|
|
|
int8_mask: true |
|
|
|
dtype: bfloat16 |
