--- base_model: - Nitral-AI/Wayfarer_Eris_Noctis-12B - nbeerbower/mistral-nemo-gutenberg3-12B - TheDrummer/Rocinante-12B-v1.1 - DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Nitral-AI/Wayfarer_Eris_Noctis-12B](https://huggingface.co/Nitral-AI/Wayfarer_Eris_Noctis-12B) as a base. ### Models Merged The following models were included in the merge: * [nbeerbower/mistral-nemo-gutenberg3-12B](https://huggingface.co/nbeerbower/mistral-nemo-gutenberg3-12B) * [TheDrummer/Rocinante-12B-v1.1](https://huggingface.co/TheDrummer/Rocinante-12B-v1.1) * [DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS](https://huggingface.co/DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: nbeerbower/mistral-nemo-gutenberg3-12B parameters: density: 0.4 weight: 0.5 - model: DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS parameters: density: 0.4 weight: 0.3 - model: TheDrummer/Rocinante-12B-v1.1 parameters: density: 0.3 weight: 0.5 merge_method: ties base_model: Nitral-AI/Wayfarer_Eris_Noctis-12B parameters: normalize: true # Normalizza i pesi int8_mask: true dtype: float16 ```