--- base_model: - Nitral-AI/Captain-Eris_Twilight-V0.420-12B - Nitral-AI/Diogenes-12B-ChatMLified library_name: transformers tags: - mergekit - merge --- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/n0HUz-yRPkwQzt3dFrjW9.png) ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/86f66Aq_j0aS5KcEhFkVp.png) # Instruct/Context import + Textgen preset combined available: [Here](https://huggingface.co/Nitral-AI/Captain-Eris-Diogenes_Twilight-V0.420-12B/tree/main/ST) ### The following models were included in the merge: * [Nitral-AI/Captain-Eris_Twilight-V0.420-12B](https://huggingface.co/Nitral-AI/Captain-Eris_Twilight-V0.420-12B) * [Nitral-AI/Diogenes-12B-ChatMLified](https://huggingface.co/Nitral-AI/Diogenes-12B-ChatMLified) ### The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: Nitral-AI/Captain-Eris_Twilight-V0.420-12B layer_range: [0, 40] - model: Nitral-AI/Diogenes-12B-ChatMLified layer_range: [0, 40] merge_method: slerp base_model: Nitral-AI/Captain-Eris_Twilight-V0.420-12B parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.420 dtype: bfloat16 ```