NearalMistral-2x7B / mergekit_moe_config.yml
Corianas's picture
Upload folder using huggingface_hub
d290558 verified
raw
history blame contribute delete
227 Bytes
base_model: mistralai/Mistral-7B-Instruct-v0.1
gate_mode: random
experts:
- source_model: mistralai/Mistral-7B-Instruct-v0.1
positive_prompts: [""]
- source_model: Corianas/Neural-Mistral-7B
positive_prompts: [""]