jieunhan
/

solar_merge_test_3

Text Generation

Mixture of Experts

yanolja/KoSOLAR-10.7B-v0.2

yanolja/Bookworm-10.7B-v0.4-DPO

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

solar_merge_test_3 / mergekit_moe_config.yml

jieunhan's picture

Upload folder using huggingface_hub

5494c6e verified 7 months ago

history blame contribute delete

391 Bytes


	base_model: yanolja/KoSOLAR-10.7B-v0.2
	dtype: float16
	experts:
	- source_model: yanolja/KoSOLAR-10.7B-v0.2
	positive_prompts: ["당신은 사람들에게 도움을 주는 어시스턴트이다."]
	- source_model: yanolja/Bookworm-10.7B-v0.4-DPO
	positive_prompts: ["당신은 다방면으로 답변을 잘하는 어시스턴트이다."]
	gate_mode: cheap_embed
	tokenizer_source: base