Hugging Face's logo

schonsense
/
Flamlama_70B_della

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
schonsense commited on
Commit
ae4ee7f
·
verified ·
1 Parent(s): b651d79

Add files using upload-large-folder tool

Browse files
Files changed (31) hide show
  1. README.md +59 -61
  2. model-00001-of-00030.safetensors +3 -0
  3. model-00002-of-00030.safetensors +3 -0
  4. model-00003-of-00030.safetensors +3 -0
  5. model-00004-of-00030.safetensors +3 -0
  6. model-00005-of-00030.safetensors +3 -0
  7. model-00006-of-00030.safetensors +3 -0
  8. model-00007-of-00030.safetensors +3 -0
  9. model-00008-of-00030.safetensors +3 -0
  10. model-00009-of-00030.safetensors +3 -0
  11. model-00010-of-00030.safetensors +3 -0
  12. model-00011-of-00030.safetensors +3 -0
  13. model-00012-of-00030.safetensors +3 -0
  14. model-00013-of-00030.safetensors +3 -0
  15. model-00014-of-00030.safetensors +3 -0
  16. model-00015-of-00030.safetensors +3 -0
  17. model-00016-of-00030.safetensors +3 -0
  18. model-00017-of-00030.safetensors +3 -0
  19. model-00018-of-00030.safetensors +3 -0
  20. model-00019-of-00030.safetensors +3 -0
  21. model-00020-of-00030.safetensors +3 -0
  22. model-00021-of-00030.safetensors +3 -0
  23. model-00022-of-00030.safetensors +3 -0
  24. model-00023-of-00030.safetensors +3 -0
  25. model-00024-of-00030.safetensors +3 -0
  26. model-00025-of-00030.safetensors +3 -0
  27. model-00026-of-00030.safetensors +3 -0
  28. model-00027-of-00030.safetensors +3 -0
  29. model-00028-of-00030.safetensors +3 -0
  30. model-00029-of-00030.safetensors +3 -0
  31. model-00030-of-00030.safetensors +3 -0
README.md CHANGED
@@ -1,61 +1,59 @@
1
- ---
2
- base_model:
3
- - schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
4
- library_name: transformers
5
- tags:
6
- - mergekit
7
- - merge
8
- ---
9
- # Flamlama_della_70B
10
-
11
- This model produces unique prose, but is virtually unuseable without babysitting each generation. It was created explicitly to add flavor and ability to a base model.
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the della merge method using schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP as a base.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * Blackroot\Mirai-3.0-70B
24
- * flammenai\Llama3.1-Flammades-70B
25
- * TsinghuaC3I\Llama-3-70B-UltraMedical
26
- * Sao10K\L3.3-70B-Euryale-v2.3
27
-
28
- ### Configuration
29
-
30
- The following YAML configuration was used to produce this model:
31
-
32
- ```yaml
33
- name: Flam_della_70B
34
- models:
35
- - model: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
36
- - model: Blackroot\Mirai-3.0-70B
37
- parameters:
38
- density: .8
39
- weight: .8
40
- - model: Sao10K\L3.3-70B-Euryale-v2.3
41
- parameters:
42
- density: .8
43
- weight: .8
44
- - model: flammenai\Llama3.1-Flammades-70B
45
- parameters:
46
- density: .8
47
- weight: .8
48
- - model: TsinghuaC3I\Llama-3-70B-UltraMedical
49
- parameters:
50
- density: .8
51
- weight: .8
52
- merge_method: della
53
- base_model: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
54
- tokenizer_source: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
55
- parameters:
56
- normalize: true
57
- int8_mask: true
58
- lambda: 1.0
59
- epsilon: 0.1
60
- dtype: float16
61
- ```
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # Flamlama_della_70B
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the della merge method using schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP as a base.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * Blackroot\Mirai-3.0-70B
22
+ * flammenai\Llama3.1-Flammades-70B
23
+ * TsinghuaC3I\Llama-3-70B-UltraMedical
24
+ * Sao10K\L3.3-70B-Euryale-v2.3
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ name: Flam_della_70B
32
+ models:
33
+ - model: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
34
+ - model: Blackroot\Mirai-3.0-70B
35
+ parameters:
36
+ density: .8
37
+ weight: .8
38
+ - model: Sao10K\L3.3-70B-Euryale-v2.3
39
+ parameters:
40
+ density: .8
41
+ weight: .8
42
+ - model: flammenai\Llama3.1-Flammades-70B
43
+ parameters:
44
+ density: .8
45
+ weight: .8
46
+ - model: TsinghuaC3I\Llama-3-70B-UltraMedical
47
+ parameters:
48
+ density: .8
49
+ weight: .8
50
+ merge_method: della
51
+ base_model: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
52
+ tokenizer_source: schonsense\Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
53
+ parameters:
54
+ normalize: true
55
+ int8_mask: true
56
+ lambda: 1.0
57
+ epsilon: 0.1
58
+ dtype: float16
59
+ ```
 
 
model-00001-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ae9b13ef6750a30beaef84f720f81e3b20a1320ac843f28da72f4cf2852852d
3
+ size 4672471496
model-00002-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40e8e06b98103a40ecd449716f9ac91280225e083752aba1f607bdbc417239d1
3
+ size 4664167376
model-00003-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5fca33c1f6c1e8001dd11a84fe5a91dfe233ebac8999e851b235c7bd738134c
3
+ size 4982917880
model-00004-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac0559306383fe1f9d4d69c37d72542914ae67cc4263c01fcae8ddba43ff2b49
3
+ size 4999711704
model-00005-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7dc458515653f0db732877998923c0622a68ad12320245e0278f542a6f17eff
3
+ size 4647373552
model-00006-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2c0962c40ddadcecb1c43b0fcdc5fac2f32ef8de53ca99962bcd4b05e632867
3
+ size 4664167376
model-00007-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377f3c9384e153dd829cfc8c27d1045c0b75f7b3e327b9f01621a1480438ed8a
3
+ size 4664167392
model-00008-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91ec0cf60becd95b8fe5f7fd6e1fa7637a720a6b41f240051eb2668bb081c4c4
3
+ size 4982917880
model-00009-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2dc39693ec1d2a0b220453830336a1d80104e13a62a921f601d91a6c379ee410
3
+ size 4999711704
model-00010-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70a316ab971b3c44042f05e71dfc3a0d524efedb3df9e371afa8f01b4c081fc3
3
+ size 4647373544
model-00011-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0121957f3d49795f2a3d4b64ff76dd6cf46e662e2baee5deb047990f4967c75a
3
+ size 4664167384
model-00012-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cff9e6e252b937503ab0a7dcd9ba96f05d2c3c3f3df34697a436d6d957f91b30
3
+ size 4664167392
model-00013-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f736424c73752d0cf9d9b667088da06695719f4ef98d117bda28acb02e08532f
3
+ size 4982917880
model-00014-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:931c83a1919b5c905167bc251b314ba44d5dfcd477f638d1b94482f11a6dc4cc
3
+ size 4999711696
model-00015-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24d9ede899d3125ae76f3b36e3c8a8c8971eccf7bb2f424662f35f7248e58ad5
3
+ size 4647373552
model-00016-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72ac287d4e404264832351f903fbb95776f0ecddca0aabe78d74ef805241e31d
3
+ size 4664167384
model-00017-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43f9faa148d3fd005d9f9b44b1f4f1bbb6f0836c72fbe14f55dec680b14412a6
3
+ size 4664167392
model-00018-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca4a0ca6c726f6ceb123add9ea52e3cf351a0d9d351da2c72f5b6d0e8489292d
3
+ size 4982917872
model-00019-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab8c9ee52f5277967dc5a2ebceff0e59b53b65e4ceebd6a80503a7023c981fd8
3
+ size 4999711704
model-00020-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efd8a968e406b68d2b8b06eb8676d41eb06aceaf4e6e79c979881a62b3b4827c
3
+ size 4647373552
model-00021-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a983b6fa06f4ab30565668f1bfc6480e5e6e59bd9ad56b7f07a95fd6dce90bbc
3
+ size 4664167384
model-00022-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1671d5a6caf603e880c4bd421d6466d0ecee138a2c746054d2d18f35a3a9c306
3
+ size 4664167384
model-00023-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:528b2c1b38f64d5efabbbeee8f040d84715b555c4bfbc40ea334189dd0475ddd
3
+ size 4982917880
model-00024-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec3afee63355f3ec098e30dc7ba91bbd44ef80dc7fb1e767240f4b963fa6ba42
3
+ size 4999711704
model-00025-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50d5790d5323811722f7278a86394cfc7af42425e64e4115dbe335918dd3c9cf
3
+ size 4647373552
model-00026-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5184c60bd07aac6d930b369213ad1aa9b35ff0e52bcf5a4229aed40926e82d78
3
+ size 4664167376
model-00027-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b264a42f2c06dad83f822f1fd30e73060b0b10192f0f0f0e42423ea82430345
3
+ size 4664167392
model-00028-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a684a2e54dfadb143b7415ef7a7f8aba0a4dcf77d1cfd6be7451aa704e70e136
3
+ size 4982917880
model-00029-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02794c03a9aecdc280d30b2e6b69c129bb70b8f7f9351c3a4a8b4ce072a54dcc
3
+ size 4999711704
model-00030-of-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccfc61b66406978ea426298db72523c3378cd0df4eb99ac7775497c4de4f80df
3
+ size 1996539352