docs: update model card
Browse files
README.md
CHANGED
@@ -15,9 +15,9 @@ tags:
|
|
15 |
# IridiumLlama-72B-v0.1
|
16 |
|
17 |
## Model Description
|
18 |
-
|
19 |
|
20 |
-
This is converted from [leafspark/Iridium-72B-v0.1](https://huggingface.co/leafspark/Iridium-72B-v0.1)
|
21 |
|
22 |
## Features
|
23 |
- 72 billion parameters
|
@@ -38,7 +38,7 @@ This is converted from [leafspark/Iridium-72B-v0.1](https://huggingface.co/leafs
|
|
38 |
- Attention layers: 560 files
|
39 |
- MLP layers: 240 files
|
40 |
- Layer norms: 160 files
|
41 |
-
- Miscellaneous (embeddings, output):
|
42 |
|
43 |
### Merging
|
44 |
Custom script utilizing safetensors library.
|
|
|
15 |
# IridiumLlama-72B-v0.1
|
16 |
|
17 |
## Model Description
|
18 |
+
IridiumLlama is a 72B parameter language model created through a merge of Qwen2-72B-Instruct, calme2.1-72b, and magnum-72b-v1 using `model_stock`.
|
19 |
|
20 |
+
This is converted from [leafspark/Iridium-72B-v0.1](https://huggingface.co/leafspark/Iridium-72B-v0.1) (currently private)
|
21 |
|
22 |
## Features
|
23 |
- 72 billion parameters
|
|
|
38 |
- Attention layers: 560 files
|
39 |
- MLP layers: 240 files
|
40 |
- Layer norms: 160 files
|
41 |
+
- Miscellaneous (embeddings, output): 162 files
|
42 |
|
43 |
### Merging
|
44 |
Custom script utilizing safetensors library.
|