metadata
base_model:
- CultriX/NeuralTrix-7B-dpo
library_name: transformers
tags:
- mergekit
- merge
license: mit
language:
- en
rizla9
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the passthrough merge method using /home/ubuntu/nvm/jas as a base.
Models Merged
The following models were included in the merge:
- /home/ubuntu/garten
Configuration
The following YAML configuration was used to produce this model:
base_model:
model:
path: /home/ubuntu/jas
dtype: float16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 29]
model:
model:
path: /home/ubuntu/garten
- sources:
- layer_range: [8, 32]
model:
model:
path: /home/ubuntu/jas