lbourdois commited on
Commit
a0300b9
·
verified ·
1 Parent(s): a27e405

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +60 -47
README.md CHANGED
@@ -1,47 +1,60 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-32B-Instruct
4
- - Qwen/Qwen2.5-Coder-32B-Instruct
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # merge
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- models:
31
- - model: Qwen/Qwen2.5-Coder-32B-Instruct
32
- parameters:
33
- weight: 1
34
- density: 1
35
- - model: Qwen/Qwen2.5-32B-Instruct
36
- parameters:
37
- weight: 1
38
- density: 1
39
- merge_method: ties
40
- base_model: Qwen/Qwen2.5-32B-Instruct
41
- parameters:
42
- weight: 1
43
- density: 1
44
- normalize: true
45
- int8_mask: true
46
- dtype: bfloat16
47
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-32B-Instruct
4
+ - Qwen/Qwen2.5-Coder-32B-Instruct
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ language:
10
+ - zho
11
+ - eng
12
+ - fra
13
+ - spa
14
+ - por
15
+ - deu
16
+ - ita
17
+ - rus
18
+ - jpn
19
+ - kor
20
+ - vie
21
+ - tha
22
+ - ara
23
+ ---
24
+ # merge
25
+
26
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
27
+
28
+ ## Merge Details
29
+ ### Merge Method
30
+
31
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
32
+
33
+ ### Models Merged
34
+
35
+ The following models were included in the merge:
36
+ * [Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)
37
+
38
+ ### Configuration
39
+
40
+ The following YAML configuration was used to produce this model:
41
+
42
+ ```yaml
43
+ models:
44
+ - model: Qwen/Qwen2.5-Coder-32B-Instruct
45
+ parameters:
46
+ weight: 1
47
+ density: 1
48
+ - model: Qwen/Qwen2.5-32B-Instruct
49
+ parameters:
50
+ weight: 1
51
+ density: 1
52
+ merge_method: ties
53
+ base_model: Qwen/Qwen2.5-32B-Instruct
54
+ parameters:
55
+ weight: 1
56
+ density: 1
57
+ normalize: true
58
+ int8_mask: true
59
+ dtype: bfloat16
60
+ ```