ch4m3l1on commited on
Commit
e1b0758
·
verified ·
1 Parent(s): 234644e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -4
README.md CHANGED
@@ -13,21 +13,33 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # pegasus-samsum
15
 
16
- This model is a fine-tuned version of [google/pegasus-cnn_dailymail](https://huggingface.co/google/pegasus-cnn_dailymail) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
  - Loss: 1.3986
19
 
20
  ## Model description
21
 
22
- More information needed
23
 
24
  ## Intended uses & limitations
25
 
26
- More information needed
27
 
28
  ## Training and evaluation data
29
 
30
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ## Training procedure
33
 
 
13
 
14
  # pegasus-samsum
15
 
16
+ This model is a fine-tuned version of [google/pegasus-cnn_dailymail](https://huggingface.co/google/pegasus-cnn_dailymail) on the SAMsum dataset.
17
  It achieves the following results on the evaluation set:
18
  - Loss: 1.3986
19
 
20
  ## Model description
21
 
22
+ The model uses PEGASUS pretrained on cnn-dailymail and it is fine-tuned on the SAMsum dataset in order to get summaries out of conversations
23
 
24
  ## Intended uses & limitations
25
 
26
+ Summarization on conversations
27
 
28
  ## Training and evaluation data
29
 
30
+ The training args are the following:
31
+ num_train_epochs=1,
32
+ warmup_steps=500,
33
+ per_device_train_batch_size=1,
34
+ per_gpu_eval_batch_size=1,
35
+ weight_decay=0.01,
36
+ logging_steps=10,
37
+ push_to_hub=True,
38
+ evaluation_strategy='steps',
39
+ eval_steps=500,
40
+ save_steps=1e6,
41
+ gradient_accumulation_steps=16,
42
+ remove_unused_columns=False,
43
 
44
  ## Training procedure
45