appvoid commited on
Commit
1a3450f
·
verified ·
1 Parent(s): bacaf11

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -36
README.md CHANGED
@@ -9,40 +9,5 @@ tags:
9
  - merge
10
 
11
  ---
12
- # merge
13
 
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
-
19
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [h2oai/h2o-danube3-500m-base](https://huggingface.co/h2oai/h2o-danube3-500m-base) as a base.
20
-
21
- ### Models Merged
22
-
23
- The following models were included in the merge:
24
- * [appvoid/arco-2](https://huggingface.co/appvoid/arco-2)
25
- * [appvoid/arco](https://huggingface.co/appvoid/arco)
26
-
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
- models:
33
- - model: appvoid/arco-2
34
- parameters:
35
- density: 0.5
36
- weight: 0.5
37
- - model: appvoid/arco
38
- parameters:
39
- density: 0.5
40
- weight: 0.5
41
-
42
- merge_method: ties
43
- base_model: h2oai/h2o-danube3-500m-base
44
- parameters:
45
- normalize: true
46
- int8_mask: true
47
- dtype: float16
48
- ```
 
9
  - merge
10
 
11
  ---
 
12
 
13
+ This is a danube-3-base language model with infused arco models for improved raw language modeling.