Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,20 @@ library_name: peft
|
|
| 3 |
---
|
| 4 |
## Training procedure
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
### Framework versions
|
| 7 |
|
| 8 |
|
|
|
|
| 3 |
---
|
| 4 |
## Training procedure
|
| 5 |
|
| 6 |
+
Used PEFT library from huggingface and leveraged LoRA procedure to tune the model. Below are the training metrics.
|
| 7 |
+
|
| 8 |
+
Epoch Training Loss Validation Loss Precision Recall F1 Accuracy
|
| 9 |
+
1 0.392600 0.347941 0.762406 0.631506 0.690810 0.882263
|
| 10 |
+
2 0.336300 0.302746 0.775583 0.702650 0.737317 0.897062
|
| 11 |
+
3 0.309500 0.294454 0.817472 0.701828 0.755249 0.905303
|
| 12 |
+
4 0.296700 0.281895 0.839335 0.695757 0.760831 0.905240
|
| 13 |
+
5 0.281700 0.273324 0.816995 0.752103 0.783207 0.914322
|
| 14 |
+
6 0.257300 0.262116 0.813662 0.758553 0.785142 0.915958
|
| 15 |
+
7 0.241200 0.255580 0.819946 0.764308 0.791150 0.918980
|
| 16 |
+
8 0.229900 0.255078 0.819697 0.771074 0.794643 0.919821
|
| 17 |
+
9 0.212800 0.248312 0.830942 0.776450 0.802772 0.922594
|
| 18 |
+
10 0.200900 0.245995 0.831402 0.780244 0.805011 0.923544
|
| 19 |
+
|
| 20 |
### Framework versions
|
| 21 |
|
| 22 |
|