YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
LLama-3.1-3x8B-MOE
base_model: meta-llama/Llama-3.1-8B-Instruct
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: Skywork/Skywork-o1-Open-Llama-3.1-8B
positive_prompts:
- "chat"
- "think"
- "I want"
- source_model: sequelbox/Llama3.1-8B-PlumCode
positive_prompts:
- "code"
- "python"
- "javascript"
- "programming"
- "algorithm"
- source_model: sequelbox/Llama3.1-8B-PlumMath
positive_prompts:
- "reason"
- "math"
- "mathematics"
- "solve"
- "count"
- Downloads last month
- 6