README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - openchat/openchat-3.5-1210
  - Open-Orca/Mistral-7B-OpenOrca

Openchat-ORCAMistral-Passtrough

Openchat-ORCAMistral-Passtrough is a merge of the following models using mergekit:

• openchat/openchat-3.5-1210
• Open-Orca/Mistral-7B-OpenOrca

🧩 Configuration

slices:
  - sources:
    - model: openchat/openchat-3.5-1210
      layer_range: [0, 24]
  - sources:
    - model: Open-Orca/Mistral-7B-OpenOrca
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16