Llama3merge6-15B-MoE / mergekit_moe_config.yml
allknowingroger's picture
Upload folder using huggingface_hub
4c7d518 verified
base_model: Kukedlc/NeuralLlamita-3-8B-v0.2
experts:
- source_model: Kukedlc/NeuralLlamita-3-8B-v0.2
positive_prompts: ["why"]
- source_model: imone/Llama-3-8B-fixed-special-embedding
positive_prompts: ["what"]