File size: 1,167 Bytes
22a0d3b
 
 
7dda6ae
22a0d3b
 
7dda6ae
6334af0
34db167
7dda6ae
 
22a0d3b
 
 
 
 
 
 
 
 
7dda6ae
 
 
 
 
 
 
 
 
 
 
 
 
 
828960f
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
license: cc-by-nc-4.0
---
## Description
This is a unified 20B model crafted via a multi-step SLERP merge of eight 20B models. The aim was to develop a versatile "base model" for TaskArithmetic in this size class.

## Merging Process:
![Mergemap](https://i.postimg.cc/kgxWt360/harmoniabracket.png)


## Models:
    - model: Undi95/Emerhyst-20B
    - model: Undi95/MXLewd-L2-20B
    - model: Undi95/Lewd-Sydney-20B
    - model: athirdpath/Nethena-20b-Glued
    - model: tavtav/Rose-20B
    - model: Undi95/PsyMedRP-v1-20B
    - model: NeverSleep/Noromaid-20b-v0.1.1
    - model: Undi95/U-Amethyst-20B


## Concept:
The idea behind this process was to blend the unique attributes of each model while minimizing individual quirks. This approach has also shown promising results as a standalone RP model, providing a combination of high-quality writing and situational problem-solving/awareness.

## Prompt template: Alpaca

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

```

Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.