|
--- |
|
license: cc-by-nc-4.0 |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
<p align="center"><font size="5"> <b>4-bit examples looking good.</b> </font></p> |
|
<p align="center"><font size="5"> <b>Try it with the glue on! (example/model is without LoRa.)</b> </font></p> |
|
<p align="center"><img src="https://iili.io/JzsUOhX.png"/> |
|
<p align="center"><font size="6"><b><a href="https://iili.io/JzsUNIt.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p> |
|
|
|
A 11b Mistral model, based on the NeverSleep recipe. |
|
|
|
### Recipe |
|
|
|
slices |
|
|
|
- sources: |
|
- |
|
- model: NeverSleep/Noromaid-7b-v0.1.1 |
|
- |
|
layer_range: [0, 24] |
|
|
|
- sources: |
|
- |
|
- model: chargoddard/loyal-piano-m7 |
|
- |
|
layer_range: [8, 32] |
|
|
|
merge_method: passthrough |
|
|
|
dtype: bfloat16 |
