File size: 1,319 Bytes
c556223 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
datasets:
- kyujinpy/KOpen-platypus
- ehartford/dolphin
library_name: peft
---
# steps-12500
| Task |Version| Metric |Value | |Stderr|
|----------------|------:|--------|-----:|---|-----:|
|kobest_boolq | 0|acc |0.5064|± |0.0133|
| | |macro_f1|0.3669|± |0.0094|
|kobest_copa | 0|acc |0.7260|± |0.0141|
| | |macro_f1|0.7254|± |0.0141|
|kobest_hellaswag| 0|acc |0.4380|± |0.0222|
| | |acc_norm|0.5460|± |0.0223|
| | |macro_f1|0.4345|± |0.0222|
|kobest_sentineg | 0|acc |0.8161|± |0.0195|
| | |macro_f1|0.8134|± |0.0199|
# steps-25000
| Task |Version| Metric |Value | |Stderr|
|----------------|------:|--------|-----:|---|-----:|
|kobest_boolq | 0|acc |0.5028|± |0.0133|
| | |macro_f1|0.3409|± |0.0069|
|kobest_copa | 0|acc |0.7170|± |0.0143|
| | |macro_f1|0.7164|± |0.0142|
|kobest_hellaswag| 0|acc |0.4380|± |0.0222|
| | |acc_norm|0.5380|± |0.0223|
| | |macro_f1|0.4329|± |0.0221|
|kobest_sentineg | 0|acc |0.7809|± |0.0208|
| | |macro_f1|0.7746|± |0.0214| |