PhiMiX-2x2B-raw / mergekit_moe_config.yml
paulilioaica's picture
Upload folder using huggingface_hub
3d40050 verified
raw
history blame
231 Bytes
base_model: rhysjones/phi-2-orange
gate_mode: random
dtype: float16
experts:
- source_model: cognitivecomputations/dolphin-2_6-phi-2
positive_prompts: [""]
- source_model: rhysjones/phi-2-orange
positive_prompts: [""]