Hugging Face's logo

h-iida
/
llm-jp-13b-merge-ties-linear

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
text-generation-inference
Model card Files Community
h-iida commited on
Commit
f4cb60d
·
verified ·
1 Parent(s): df3283d

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. README.md +3 -2
  2. mergekit_config.yml +2 -1
  3. model-00001-of-00006.safetensors +1 -1
  4. model-00002-of-00006.safetensors +1 -1
  5. model-00003-of-00006.safetensors +1 -1
  6. model-00004-of-00006.safetensors +1 -1
  7. model-00005-of-00006.safetensors +1 -1
  8. model-00006-of-00006.safetensors +1 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  base_model:
3
- - llm-jp/llm-jp-3-13b-instruct
4
  - llm-jp/llm-jp-3-13b
 
5
  library_name: transformers
6
  tags:
7
  - mergekit
@@ -29,9 +29,10 @@ The following YAML configuration was used to produce this model:
29
  ```yaml
30
 
31
  models:
 
32
  - model: llm-jp/llm-jp-3-13b-instruct
33
  parameters:
34
- weight: 0.99
35
  merge_method: dare_linear
36
  base_model: llm-jp/llm-jp-3-13b
37
  parameters:
 
1
  ---
2
  base_model:
 
3
  - llm-jp/llm-jp-3-13b
4
+ - llm-jp/llm-jp-3-13b-instruct
5
  library_name: transformers
6
  tags:
7
  - mergekit
 
29
  ```yaml
30
 
31
  models:
32
+ - model: llm-jp/llm-jp-3-13b
33
  - model: llm-jp/llm-jp-3-13b-instruct
34
  parameters:
35
+ weight: 1
36
  merge_method: dare_linear
37
  base_model: llm-jp/llm-jp-3-13b
38
  parameters:
mergekit_config.yml CHANGED
@@ -1,8 +1,9 @@
1
 
2
  models:
 
3
  - model: llm-jp/llm-jp-3-13b-instruct
4
  parameters:
5
- weight: 0.99
6
  merge_method: dare_linear
7
  base_model: llm-jp/llm-jp-3-13b
8
  parameters:
 
1
 
2
  models:
3
+ - model: llm-jp/llm-jp-3-13b
4
  - model: llm-jp/llm-jp-3-13b-instruct
5
  parameters:
6
+ weight: 1
7
  merge_method: dare_linear
8
  base_model: llm-jp/llm-jp-3-13b
9
  parameters:
model-00001-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7660499d3fc24eaffb14cf418d84187082e7ba61f73b382b28b42a216a30e89d
3
  size 4860246680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75c70e55c79f37261d63122f5fa9741d0ba412c7d1c7f0b7afc5d3307986c951
3
  size 4860246680
model-00002-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:45f7235d7b9f5cac8181b5fde8716f532d21582ee8a65cbf5c79721aab7e2bf2
3
  size 4933722216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5b720d08bfa70e95f5450ffef1ef2b86fc16b3054d384cfe48a9626554cd559
3
  size 4933722216
model-00003-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd019328a7d46b7d2cfe4d69e1969e0151d8ffcb548d82bc0ddf00ab39ece828
3
  size 4933722216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cbcf8e63defcd719960535fa3388e4577bf544bc0010c208013336c6d2dcd17
3
  size 4933722216
model-00004-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0150f604f83468b9a37f018eabef68e7c308cc54f75837d2362e3e84c5883a7
3
  size 4970411904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c15aecb7d51e3558dfb3b8c925d07169e477664e20f9bab57e2778f753b19cf4
3
  size 4970411904
model-00005-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b86a74cebd68bcdc7537855eeb0ea6d2bb51ae8aba65b1199850ec3c458b762
3
  size 4970422248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b81fc388680c2359691dbde337c1829cca50530ad52a7e9017f836f82fd0277a
3
  size 4970422248
model-00006-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4727d88f5c7948bb7e3dea15e67ba43107af9ddd6a0b7eb8840c703e1c38dd22
3
  size 2747366008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc41c281e5f88f145164bb88ff7a50dd2395af50e7dcb68eb1876ca1a538c830
3
  size 2747366008