training completed[prod]: T5-base-lora

README.md

@@ -1,8 +1,9 @@
 ---
+license: apache-2.0
 library_name: peft
 tags:
 - generated_from_trainer
-base_model: google/pegasus-xsum
+base_model: t5-base
 model-index:
 - name: T5-lora-legalease
   results: []
@@ -13,9 +14,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # T5-lora-legalease
 
-This model is a fine-tuned version of [google/pegasus-xsum](https://huggingface.co/google/pegasus-xsum) on an unknown dataset.
+This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.5452
+- Loss: 1.1673
 
 ## Model description
 
@@ -47,17 +48,17 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 0.18  | 250  | 4.1826          |
-| 4.6756        | 0.35  | 500  | 3.8860          |
-| 4.6756        | 0.53  | 750  | 3.7923          |
-| 3.8476        | 0.71  | 1000 | 3.7309          |
-| 3.8476        | 0.89  | 1250 | 3.6762          |
-| 3.7406        | 1.06  | 1500 | 3.6374          |
-| 3.7406        | 1.24  | 1750 | 3.6072          |
-| 3.6278        | 1.42  | 2000 | 3.5841          |
-| 3.6278        | 1.6   | 2250 | 3.5630          |
-| 3.6359        | 1.77  | 2500 | 3.5509          |
-| 3.6359        | 1.95  | 2750 | 3.5452          |
+| No log        | 0.18  | 250  | 1.3037          |
+| 1.6713        | 0.35  | 500  | 1.2525          |
+| 1.6713        | 0.53  | 750  | 1.2217          |
+| 1.3129        | 0.71  | 1000 | 1.2068          |
+| 1.3129        | 0.89  | 1250 | 1.1978          |
+| 1.292         | 1.06  | 1500 | 1.1856          |
+| 1.292         | 1.24  | 1750 | 1.1794          |
+| 1.253         | 1.42  | 2000 | 1.1769          |
+| 1.253         | 1.6   | 2250 | 1.1725          |
+| 1.2529        | 1.77  | 2500 | 1.1693          |
+| 1.2529        | 1.95  | 2750 | 1.1673          |
 
 
 ### Framework versions

runs/Apr02_06-46-40_ba3afbe869fb/events.out.tfevents.1712040402.ba3afbe869fb.232.1

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a39a4f71af6bcb6b5c985eeb24e7b3a7e499a642629ddffac240668ab779442d
-size 8589
+oid sha256:592f5a1c7cad0d690fcfbed575f7cfce208ba4c9cf882a6b55904b5daefd3f51
+size 9967