End of training

README.md

@@ -21,7 +21,7 @@ model-index:
     metrics:
     - name: Rouge1
       type: rouge
-      value: 0.3724824193877514
+      value: 0.38124598557029016
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -31,11 +31,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [allenai/led-base-16384](https://huggingface.co/allenai/led-base-16384) on the cnn_dailymail dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.9320
-- Rouge1: 0.3725
-- Rouge2: 0.1570
-- Rougel: 0.2429
-- Rougelsum: 0.3515
+- Loss: 1.6312
+- Rouge1: 0.3812
+- Rouge2: 0.1691
+- Rougel: 0.2544
+- Rougelsum: 0.3599
 
 ## Model description
 
@@ -55,11 +55,11 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 1
-- eval_batch_size: 1
+- train_batch_size: 2
+- eval_batch_size: 2
 - seed: 42
-- gradient_accumulation_steps: 8
-- total_train_batch_size: 8
+- gradient_accumulation_steps: 64
+- total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 5
@@ -80,6 +80,12 @@ The following hyperparameters were used during training:
 | 1.0735        | 4.0   | 5000 | 1.8772          | 0.3653 | 0.1557 | 0.2399 | 0.3454    |
 | 0.9106        | 4.4   | 5500 | 1.9401          | 0.3720 | 0.1585 | 0.2436 | 0.3504    |
 | 1.015         | 4.8   | 6000 | 1.9320          | 0.3725 | 0.1570 | 0.2429 | 0.3515    |
+| 1.7854        | 0.36  | 6500 | 1.7800          | 0.3624 | 0.1544 | 0.2390 | 0.3422    |
+| 1.9079        | 0.39  | 7000 | 1.7629          | 0.3573 | 0.1553 | 0.2352 | 0.3370    |
+| 1.7606        | 3.34  | 7500 | 1.6902          | 0.3783 | 0.1673 | 0.2521 | 0.3570    |
+| 1.7571        | 3.57  | 8000 | 1.6563          | 0.3802 | 0.1691 | 0.2538 | 0.3587    |
+| 1.6602        | 3.79  | 8500 | 1.6439          | 0.3814 | 0.1693 | 0.2548 | 0.3600    |
+| 1.6614        | 4.01  | 9000 | 1.6312          | 0.3812 | 0.1691 | 0.2544 | 0.3599    |
 
 
 ### Framework versions

generation_config.json

@@ -1,12 +1,8 @@
 {
+  "_from_model_config": true,
   "bos_token_id": 0,
   "decoder_start_token_id": 2,
-  "early_stopping": true,
   "eos_token_id": 2,
-  "length_penalty": 2.0,
-  "max_length": 1024,
-  "min_length": 100,
-  "no_repeat_ngram_size": 3,
   "pad_token_id": 1,
   "transformers_version": "4.30.2"
 }

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f5c1c5e19a7d4ec0e6d763e8cff438b377c874eeaa951c2e271161875c18902
+oid sha256:a209fd536ca62e5fb6a1655c5cbd31cffe9d398af5785f8977657aa8cff87f6c
 size 4091