File size: 1,696 Bytes
96db836 1ae116a 96db836 8ca7600 96db836 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 |
---
base_model: beomi/Solar-Ko-Recovery-11B
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---
# KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged
LoRA merged model from beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B
- **Developed by:** beomi
- **License:** apache-2.0
- **Finetuned from model :** beomi/Solar-Ko-Recovery-11B
## Eval with LogicKor
**Default**
| Category | Single turn | Multi turn |
|---|---|---|
| 이해(Understanding) | 8.43 | 5.86 |
| 수학(Math) | 3.86 | 1.00 |
| 글쓰기(Writing) | 9.71 | 7.71 |
| 추론(Reasoning) | 7.57 | 3.86 |
| 코딩(Coding) | 7.57 | 7.00 |
| 문법(Grammar) | 7.43 | 4.14 |
| Category | Score |
|---|---|
| Single turn | 7.43 |
| Multi turn | 4.93 |
| Overall | 6.18 |
**1-Shot**
| Category | Single turn | Multi turn |
|---|---|---|
| 추론(Reasoning) | 7.57 | 4.43 |
| 코딩(Coding) | 7.29 | 8.57 |
| 수학(Math) | 2.86 | 1.71 |
| 글쓰기(Writing) | 9.29 | 7.57 |
| 이해(Understanding) | 7.43 | 5.86 |
| 문법(Grammar) | 7.29 | 4.71 |
| Category | Score |
|---|---|
| Single turn | 6.95 |
| Multi turn | 5.48 |
| Overall | 6.21 |
**CoT-1-Shot**
| Category | Single turn | Multi turn |
|---|---|---|
| 코딩(Coding) | 7.14 | 8.14 |
| 추론(Reasoning) | 6.86 | 3.57 |
| 글쓰기(Writing) | 9.71 | 7.71 |
| 수학(Math) | 2.29 | 1.14 |
| 이해(Understanding) | 7.43 | 7.00 |
| 문법(Grammar) | 7.29 | 3.14 |
| Category | Score |
|---|---|
| Single turn | 6.79 |
| Multi turn | 5.12 |
| Overall | 5.95 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|