--- base_model: - Jacoby746/Casual-Magnum-34B tags: - mergekit - merge --- Currently WIP, may not work right now. # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * /home/jacoby/Downloads/text-generation-webui/models/NeverSleep_CausalLM-RP-34B * /home/jacoby/Downloads/text-generation-webui/models/anthracite-org_magnum-v3-34b ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: /home/jacoby/Downloads/text-generation-webui/models/anthracite-org_magnum-v3-34b - model: /home/jacoby/Downloads/text-generation-webui/models/NeverSleep_CausalLM-RP-34B merge_method: slerp base_model: /home/jacoby/Downloads/text-generation-webui/models/NeverSleep_CausalLM-RP-34B parameters: t: - value: [0, 0.1, 0.2, 0.4, 0.5, 0.6, 0.5, 0.4, 0.2, 0.1, 0] embed_slerp: true dtype: float16 ```