Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ library_name: transformers
|
|
10 |
tags:
|
11 |
- mergekit
|
12 |
- merge
|
13 |
-
|
14 |
---
|
15 |
# merge
|
16 |
|
@@ -20,15 +20,21 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
20 |
### Merge Method
|
21 |
|
22 |
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Nexesenex/Llama_3.x_70b_SmarTracks_V1.01](https://huggingface.co/Nexesenex/Llama_3.x_70b_SmarTracks_V1.01) as a base.
|
|
|
23 |
|
24 |
### Models Merged
|
25 |
|
26 |
The following models were included in the merge:
|
27 |
* [SentientAGI/Dobby-Unhinged-Llama-3.3-70B](https://huggingface.co/SentientAGI/Dobby-Unhinged-Llama-3.3-70B)
|
|
|
28 |
* [Black-Ink-Guild/Pernicious_Prophecy_70B](https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B)
|
|
|
29 |
* [LatitudeGames/Wayfarer-Large-70B-Llama-3.3](https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3)
|
|
|
30 |
* [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
|
|
|
31 |
* [Nexesenex/Llama_3.1_70b_TearDrops_V1.11](https://huggingface.co/Nexesenex/Llama_3.1_70b_TearDrops_V1.11)
|
|
|
32 |
|
33 |
### Configuration
|
34 |
|
@@ -62,4 +68,4 @@ parameters:
|
|
62 |
chat_template: auto
|
63 |
tokenizer:
|
64 |
source: union
|
65 |
-
```
|
|
|
10 |
tags:
|
11 |
- mergekit
|
12 |
- merge
|
13 |
+
license: llama3.3
|
14 |
---
|
15 |
# merge
|
16 |
|
|
|
20 |
### Merge Method
|
21 |
|
22 |
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Nexesenex/Llama_3.x_70b_SmarTracks_V1.01](https://huggingface.co/Nexesenex/Llama_3.x_70b_SmarTracks_V1.01) as a base.
|
23 |
+
- the "Smart base" of the model, a 3 levels merge-stock mix of Llama 3.3 abliterated finetuned (the root), Deepseek R1 Distill based Fallen Llama, Nemotron and Tulu.
|
24 |
|
25 |
### Models Merged
|
26 |
|
27 |
The following models were included in the merge:
|
28 |
* [SentientAGI/Dobby-Unhinged-Llama-3.3-70B](https://huggingface.co/SentientAGI/Dobby-Unhinged-Llama-3.3-70B)
|
29 |
+
- for its.. unhinged "personality traits".
|
30 |
* [Black-Ink-Guild/Pernicious_Prophecy_70B](https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B)
|
31 |
+
- a balanced healed merge-stock steering with Eva (creativity), Negative Llama (debiasing), L3.1 Oblivion (general intelligence), Open-Bio (anatomy and medicine).
|
32 |
* [LatitudeGames/Wayfarer-Large-70B-Llama-3.3](https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3)
|
33 |
+
- to darken the model and the RP scenarios.
|
34 |
* [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
|
35 |
+
- to highlight and consolidate the R1 capabilities and spice-up/darken the model.
|
36 |
* [Nexesenex/Llama_3.1_70b_TearDrops_V1.11](https://huggingface.co/Nexesenex/Llama_3.1_70b_TearDrops_V1.11)
|
37 |
+
- A legacy 3.1 merge, led by Tess R1, including the Hermes based Gutemberg Doppel and an uncensored creative finetune.
|
38 |
|
39 |
### Configuration
|
40 |
|
|
|
68 |
chat_template: auto
|
69 |
tokenizer:
|
70 |
source: union
|
71 |
+
```
|