OddTheGreat commited on
Commit
b361aff
·
verified ·
1 Parent(s): a68ea91

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -44
README.md CHANGED
@@ -8,53 +8,18 @@ library_name: transformers
8
  tags:
9
  - mergekit
10
  - merge
11
-
 
 
 
 
12
  ---
13
  # merge
14
 
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [RefalMachine/RuadaptQwen2.5-32B-Pro-Beta](https://huggingface.co/RefalMachine/RuadaptQwen2.5-32B-Pro-Beta) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [Sao10K/32B-Qwen2.5-Kunou-v1](https://huggingface.co/Sao10K/32B-Qwen2.5-Kunou-v1)
26
- * [ParasiticRogue/EVA-Instruct-32B-v2](https://huggingface.co/ParasiticRogue/EVA-Instruct-32B-v2)
27
- * [allura-org/Qwen2.5-32b-RP-Ink](https://huggingface.co/allura-org/Qwen2.5-32b-RP-Ink)
28
-
29
- ### Configuration
30
 
31
- The following YAML configuration was used to produce this model:
32
 
33
- ```yaml
34
- models:
35
- - model: ParasiticRogue/EVA-Instruct-32B-v2
36
- parameters:
37
- density: 0.3
38
- weight: 0.3
39
- - model: allura-org/Qwen2.5-32b-RP-Ink
40
- parameters:
41
- density: 0.3
42
- weight: 0.3
43
- - model: Sao10K/32B-Qwen2.5-Kunou-v1
44
- parameters:
45
- density: 0.3
46
- weight: 0.3
47
- - model: RefalMachine/RuadaptQwen2.5-32B-Pro-Beta
48
- parameters:
49
- density: 0.8
50
- weight: 0.8
51
 
52
- merge_method: ties
53
- base_model: RefalMachine/RuadaptQwen2.5-32B-Pro-Beta
54
- parameters:
55
- normalize: false
56
- int8_mask: true
57
- dtype: float16
58
- tokenizer:
59
- source: ParasiticRogue/EVA-Instruct-32B-v2
60
- ```
 
8
  tags:
9
  - mergekit
10
  - merge
11
+ - roleplay
12
+ - creative
13
+ language:
14
+ - en
15
+ - ru
16
  ---
17
  # merge
18
 
19
+ This is a merge of pre-trained qwen2.5 32B language models
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
+ Goal of this merge was to create big (on my standarts) roleplay model capable to russian.
22
 
23
+ Well, model is good in roleplay and capable to ru text. Also, during my quick tests ( ~100 answers, because generation is too slow on my PC) model seemed to be creative, uncensored, and smart.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
 
25
+ For now i stop merge or test models bigger than 24B, my hardware is not ready. yet.