MS-Quadrosiac-2409-22B / mergekit_config.yml
Kaoeiri's picture
Upload folder using huggingface_hub
4b950f4 verified
raw
history blame contribute delete
565 Bytes
models:
- model: Kaoeiri/MS-Physician-2409-22B
parameters:
weight: 0.42
density: 1
- model: Kaoeiri/MS_springydragon-2409-22B
parameters:
weight: 0.7
density: 0.85
- model: Kaoeiri/MS_dampf-2409-22B
parameters:
weight: 0.8
density: 0.85
- model: Kaoeiri/MS_fujin-2409-22B
parameters:
weight: 0.7
density: 0.85
merge_method: dare_ties
base_model: unsloth/Mistral-Small-Instruct-2409
parameters:
density: 0.85
epsilon: 0.07
lambda: 1.25
normalize: false
dtype: bfloat16
tokenizer_source: union