Umbra-v3-MoE-4x11b / mergekit_moe_config.yml
Steelskull's picture
Upload folder using huggingface_hub
fc804ad verified
raw
history blame
2.2 kB
base_model: vicgalle/CarbonBeagle-11B-truthy
gate_mode: hidden
dtype: bfloat16
experts_per_token: 4
experts:
- source_model: Himitsui/Kaiju-11B
positive_prompts:
- "Imagine"
- "Create"
- "Envision"
- "Fantasize"
- "Invent"
- "Narrate"
- "Plot"
- "Portray"
- "Storytell"
- "Visualize"
- "Describe"
- "Develop"
- "Forge"
- "Craft"
- "Conceptualize"
- "Dream"
- "Concoct"
- "Characterize"
negative_prompts:
- "Recite"
- "Report"
- "Summarize"
- "Enumerate"
- "List"
- "Cite"
- source_model: Sao10K/Fimbulvetr-11B-v2
positive_prompts:
- "Dramatize"
- "Embody"
- "Illustrate"
- "Perform"
- "Roleplay"
- "Simulate"
- "Stage"
- "Unfold"
- "Weave"
- "Design"
- "Outline"
- "Script"
- "Sketch"
- "Spin"
- "Depict"
- "Render"
- "Fashion"
- "Conceive"
negative_prompts:
- "Analyze"
- "Critique"
- "Dissect"
- "Explain"
- "Clarify"
- "Interpret"
- source_model: decapoda-research/Antares-11b-v2
positive_prompts:
- "Solve"
- "Respond"
- "Convey"
- "Disclose"
- "Expound"
- "Narrate"
- "Present"
- "Reveal"
- "Specify"
- "Uncover"
- "Decode"
- "Examine"
- "Report"
- "Survey"
- "Validate"
- "Verify"
- "Question"
- "Query"
negative_prompts:
- "Divert"
- "Obscure"
- "Overstate"
- "Undermine"
- "Misinterpret"
- "Skew"
- source_model: beberik/Nyxene-v3-11B
positive_prompts:
- "Explain"
- "Instruct"
- "Clarify"
- "Educate"
- "Guide"
- "Inform"
- "Teach"
- "Detail"
- "Elaborate"
- "Enlighten"
- "Advise"
- "Interpret"
- "Analyze"
- "Define"
- "Demonstrate"
- "Illustrate"
- "Simplify"
- "Summarize"
negative_prompts:
- "Speculate"
- "Fabricate"
- "Exaggerate"
- "Mislead"
- "Confuse"
- "Distort"