Explanation

  • With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part
  • Attached the base model and the tuned adapter together

Base Model

Used Corpus

Score

Average Ko-ARC Ko-HellaSwag Ko-MMLU Ko-TruthfulQA Ko-CommonGen V2
56.24 53.33 64.36 55.63 45.42 62.46

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • Apache 2.0
Downloads last month
2,503
Safetensors
Model size
10.8B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for dddsaty/KoSOLAR-10.7B_DPO_Adapter_Attach

Quantizations
1 model

Dataset used to train dddsaty/KoSOLAR-10.7B_DPO_Adapter_Attach