T3Q-ko-solar-dpo-v6.0
This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
Model Developers Chihoon Lee(chihoonlee10), T3Q
hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5028 | ± | 0.0133 |
| macro_f1 | 0.3396 | ± | 0.0067 | ||
| kobest_copa | 0 | acc | 0.8020 | ± | 0.0126 |
| macro_f1 | 0.8018 | ± | 0.0126 | ||
| kobest_hellaswag | 0 | acc | 0.5340 | ± | 0.0223 |
| acc_norm | 0.5720 | ± | 0.0221 | ||
| macro_f1 | 0.5322 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.7985 | ± | 0.0202 |
| macro_f1 | 0.7956 | ± | 0.0205 |
- Downloads last month
- 1,517
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.