Update README.md
Browse files
README.md
CHANGED
|
@@ -51,6 +51,20 @@ lora_config = LoraConfig(
|
|
| 51 |
)
|
| 52 |
```
|
| 53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
### Hardware
|
| 55 |
- RTX 3090 Ti 24GB x 1
|
| 56 |
- Training Time : 80 hours
|
|
|
|
| 51 |
)
|
| 52 |
```
|
| 53 |
|
| 54 |
+
### Model Evaluation
|
| 55 |
+
|
| 56 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 57 |
+
|-----------------|-------|------|-----:|-----------|---|-----:|---|------|
|
| 58 |
+
|kobest_boolq | 1|none | 0|acc |↑ |0.5912|± |0.0131|
|
| 59 |
+
| | |none | 0|f1 |↑ |0.5183|± |N/A |
|
| 60 |
+
|kobest_copa | 1|none | 0|acc |↑ |0.6320|± |0.0153|
|
| 61 |
+
| | |none | 0|f1 |↑ |0.6313|± |N/A |
|
| 62 |
+
|kobest_hellaswag | 1|none | 0|acc |↑ |0.4220|± |0.0221|
|
| 63 |
+
| | |none | 0|acc_norm |↑ |0.5280|± |0.0223|
|
| 64 |
+
| | |none | 0|f1 |↑ |0.4190|± |N/A |
|
| 65 |
+
|kobest_sentineg | 1|none | 0|acc |↑ |0.4962|± |0.0251|
|
| 66 |
+
| | |none | 0|f1 |↑ |0.3747|± |N/A |
|
| 67 |
+
|
| 68 |
### Hardware
|
| 69 |
- RTX 3090 Ti 24GB x 1
|
| 70 |
- Training Time : 80 hours
|