license: apache-2.0 | |
tags: | |
- merge | |
- mergekit | |
- lazymergekit | |
# Turkish-moe | |
Turkish-moe is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): | |
## 🧩 Configuration | |
```yaml | |
base_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0 | |
dtype: float16 | |
gate_mode: cheap_embed | |
experts: | |
- source_model: TURKCELL/Turkcell-LLM-7b-v1 | |
positive_prompts: ["You are an helpful general-pupose assistant."] | |
- source_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0 | |
positive_prompts: ["You are helpful assistant."] | |
``` |