--- base_model: - Solshine/reflection-llama-3.1-8B - allenai/Llama-3.1-Tulu-3-8B - meditsolutions/Llama-3.1-MedIT-SUN-8B - Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 - arcee-ai/Llama-3.1-SuperNova-Lite - ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the della_linear merge method using [Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2) as a base. ### Models Merged The following models were included in the merge: * [Solshine/reflection-llama-3.1-8B](https://huggingface.co/Solshine/reflection-llama-3.1-8B) * [allenai/Llama-3.1-Tulu-3-8B](https://huggingface.co/allenai/Llama-3.1-Tulu-3-8B) * [meditsolutions/Llama-3.1-MedIT-SUN-8B](https://huggingface.co/meditsolutions/Llama-3.1-MedIT-SUN-8B) * [arcee-ai/Llama-3.1-SuperNova-Lite](https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite) * [ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3](https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3 parameters: density: 0.5 weight: 0.5 - model: Solshine/reflection-llama-3.1-8B parameters: density: 0.5 weight: 0.5 - model: arcee-ai/Llama-3.1-SuperNova-Lite parameters: weight: 1.0 - model: allenai/Llama-3.1-Tulu-3-8B parameters: weight: 1.0 - model: meditsolutions/Llama-3.1-MedIT-SUN-8B parameters: weight: 1.0 merge_method: della_linear base_model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 parameters: normalize: false int8_mask: true dtype: float16 ```