Qwen15-DeepSeekCoder-Merge / mergekit_config.yml
Davidsv's picture
Upload folder using huggingface_hub
90c25b8 verified
slices:
- sources:
- model: Qwen/Qwen1.5-7B-Chat
layer_range: [0, 32]
- model: deepseek-ai/deepseek-coder-6.7b-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: Qwen/Qwen1.5-7B-Chat
parameters:
t: 0.6
dtype: bfloat16