---
base_model:
- Qwen/Qwen2.5-72B-Instruct
- Replete-AI/Replete-LLM-V2.5-Qwen-7b
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the passthrough merge method.

This model recieved no post merge retraining (yet) and minimal testing. Please contribute any feedback or evaluations of any kind via the community tab.

### Models Merged

The following models were included in the merge:
* [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
* [Replete-AI/Replete-LLM-V2.5-Qwen-7b](https://huggingface.co/Replete-AI/Replete-LLM-V2.5-Qwen-7b)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
slices:
  # Replete-AI Layer 0, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]

  # Qwen 72B Layer 0, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]

  # Replete-AI Layer 1, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]

  # Qwen 72B Layer 1, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]

  # Replete-AI Layer 2, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]

  # Qwen 72B Layer 2, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]

  # Replete-AI Layer 3, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]

  # Qwen 72B Layer 3, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]

  # Replete-AI Layer 4, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]

  # Qwen 72B Layer 4, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]

  # Replete-AI Layer 5, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]

  # Qwen 72B Layer 5, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]

  # Replete-AI Layer 6, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]

  # Qwen 72B Layer 6, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]

  # Replete-AI Layer 7, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]

  # Qwen 72B Layer 7, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]

  # Replete-AI Layer 8, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]

  # Qwen 72B Layer 8, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]

  # Replete-AI Layer 9, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]

  # Qwen 72B Layer 9, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]

  # Replete-AI Layer 10, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]

  # Qwen 72B Layer 10, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]

  # Replete-AI Layer 11, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]

  # Qwen 72B Layer 11, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]

  # Replete-AI Layer 12, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]

  # Qwen 72B Layer 12, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]

  # Replete-AI Layer 13, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]

  # Qwen 72B Layer 13, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]

  # Replete-AI Layer 14, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]

  # Qwen 72B Layer 14, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]

  # Replete-AI Layer 15, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]

  # Qwen 72B Layer 15, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]

  # Replete-AI Layer 16, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]

  # Qwen 72B Layer 16, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]

  # Replete-AI Layer 17, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]

  # Qwen 72B Layer 17, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]

  # Replete-AI Layer 18, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]

  # Qwen 72B Layer 18, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]

  # Replete-AI Layer 19, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]

  # Qwen 72B Layer 19, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]

  # Replete-AI Layer 20, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]

  # Qwen 72B Layer 20, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]

  # Replete-AI Layer 21, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]

  # Qwen 72B Layer 21, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]

  # Replete-AI Layer 22, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]

  # Qwen 72B Layer 22, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]

  # Replete-AI Layer 23, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]

  # Qwen 72B Layer 23, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]

  # Replete-AI Layer 24, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]

  # Qwen 72B Layer 24, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]

  # Replete-AI Layer 25, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]

  # Qwen 72B Layer 25, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]

  # Replete-AI Layer 26, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]

  # Qwen 72B Layer 26, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]

  # Replete-AI Layer 27, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]

  # Qwen 72B Layer 27, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [27, 80]

merge_method: passthrough
dtype: float16

```