--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - openchat/openchat-3.5-1210 - Open-Orca/Mistral-7B-OpenOrca --- # Openchat-ORCAMistral-Passtrough Openchat-ORCAMistral-Passtrough is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [openchat/openchat-3.5-1210](https://huggingface.co/openchat/openchat-3.5-1210) * [Open-Orca/Mistral-7B-OpenOrca](https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca) ## 🧩 Configuration ```yaml slices: - sources: - model: openchat/openchat-3.5-1210 layer_range: [0, 24] - sources: - model: Open-Orca/Mistral-7B-OpenOrca layer_range: [8, 32] merge_method: passthrough dtype: bfloat16 ```