beomi commited on
Commit
8ca7600
1 Parent(s): a645944

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -1
README.md CHANGED
@@ -17,6 +17,58 @@ tags:
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** beomi/Solar-Ko-Recovery-11B
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** beomi/Solar-Ko-Recovery-11B
19
 
20
+ ## Eval with LogicKor
21
+
22
+ **Default**
23
+
24
+ | Category | Single turn | Multi turn |
25
+ |---|---|---|
26
+ | 이해(Understanding) | 8.43 | 5.86 |
27
+ | 수학(Math) | 3.86 | 1.00 |
28
+ | 글쓰기(Writing) | 9.71 | 7.71 |
29
+ | 추론(Reasoning) | 7.57 | 3.86 |
30
+ | 코딩(Coding) | 7.57 | 7.00 |
31
+ | 문법(Grammar) | 7.43 | 4.14 |
32
+
33
+ | Category | Score |
34
+ |---|---|
35
+ | Single turn | 7.43 |
36
+ | Multi turn | 4.93 |
37
+ | Overall | 6.18 |
38
+
39
+ **1-Shot**
40
+
41
+ | Category | Single turn | Multi turn |
42
+ |---|---|---|
43
+ | 추론(Reasoning) | 7.57 | 4.43 |
44
+ | 코딩(Coding) | 7.29 | 8.57 |
45
+ | 수학(Math) | 2.86 | 1.71 |
46
+ | 글쓰기(Writing) | 9.29 | 7.57 |
47
+ | 이해(Understanding) | 7.43 | 5.86 |
48
+ | 문법(Grammar) | 7.29 | 4.71 |
49
+
50
+ | Category | Score |
51
+ |---|---|
52
+ | Single turn | 6.95 |
53
+ | Multi turn | 5.48 |
54
+ | Overall | 6.21 |
55
+
56
+
57
+ **CoT-1-Shot**
58
+
59
+ | Category | Single turn | Multi turn |
60
+ |---|---|---|
61
+ | 코딩(Coding) | 7.14 | 8.14 |
62
+ | 추론(Reasoning) | 6.86 | 3.57 |
63
+ | 글쓰기(Writing) | 9.71 | 7.71 |
64
+ | 수학(Math) | 2.29 | 1.14 |
65
+ | 이해(Understanding) | 7.43 | 7.00 |
66
+ | 문법(Grammar) | 7.29 | 3.14 |
67
+
68
+ | Category | Score |
69
+ |---|---|
70
+ | Single turn | 6.79 |
71
+ | Multi turn | 5.12 |
72
+ | Overall | 5.95 |
73
 
74
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)