--- base_model: - EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1 - allura-org/Teleut-7b - FourOhFour/Vapor_v2_7B library_name: transformers tags: - mergekit - merge --- # temp This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the NuSLERP merge method using [EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1) as a base. ### Models Merged The following models were included in the merge: * [allura-org/Teleut-7b](https://huggingface.co/allura-org/Teleut-7b) * [FourOhFour/Vapor_v2_7B](https://huggingface.co/FourOhFour/Vapor_v2_7B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: allura-org/Teleut-7b parameters: weight: 0.6 - model: FourOhFour/Vapor_v2_7B parameters: weight: 0.2 - model: EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1 parameters: weight: 1.0 merge_method: nuslerp base_model: EVA-UNIT-01/EVA-Qwen2.5-7B-v0.1 parameters: normalize: true int8_mask: true nuslerp_flatten: false nuslerp_row_wise: true dtype: float16 ```