Explanation

  • With the base model, attached the DPO applied Adapter

Base Model

Adapter Base Model

Adapter Corpus

Score

Average ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K
76.09 73.89 88.94 65.03 71.24 87.61 69.83

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • MIT
Downloads last month
133
Safetensors
Model size
12.9B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach