Update README.md

README.md

@@ -1,3 +1,52 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+base_model:
+- rombodawg/Rombos-LLM-V2.5-Qwen-32b
+library_name: transformers
+tags:
+- merge
+- mergekit
+---
+# merge
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [DELLA](https://arxiv.org/abs/2406.11617) merge method using C:\Users\silve\Applications\mergekit\writing-model-good as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [Rombos-LLM-V2.5-Qwen-32b][https://huggingface.co/rombodawg/Rombos-LLM-V2.5-Qwen-32b]
+* [EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2)
+* [allura-org/Qwen2.5-32b-RP-Ink](https://huggingface.co/allura-org/Qwen2.5-32b-RP-Ink)
+* [nbeerbower/Qwen2.5-Gutenberg-Doppel-32B](https://huggingface.co/nbeerbower/Qwen2.5-Gutenberg-Doppel-32B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: rombodawg/Rombos-LLM-V2.5-Qwen-32b
+parameters:
+  int8_mask: true
+  rescale: false
+  normalize: true
+dtype: bfloat16
+tokenizer_source: union
+merge_method: dare_ties
+models:
+  - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
+    parameters:
+      weight: [0.4]
+      density: [0.55]
+  - model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
+    parameters:
+      weight: [0.3]
+      density: [0.55]
+  - model: allura-org/Qwen2.5-32b-RP-Ink
+    parameters:
+      weight: [0.4]
+      density: [0.55]