jakeboggs commited on
Commit
4c0b0b5
·
verified ·
1 Parent(s): 81c893f

End of training

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -37,12 +37,12 @@ The following hyperparameters were used during training:
37
  - train_batch_size: 1
38
  - eval_batch_size: 8
39
  - seed: 42
40
- - gradient_accumulation_steps: 8
41
- - total_train_batch_size: 8
42
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - lr_scheduler_warmup_steps: 100
45
- - num_epochs: 3
46
 
47
  ### Training results
48
 
 
37
  - train_batch_size: 1
38
  - eval_batch_size: 8
39
  - seed: 42
40
+ - gradient_accumulation_steps: 32
41
+ - total_train_batch_size: 32
42
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - lr_scheduler_warmup_steps: 100
45
+ - num_epochs: 4
46
 
47
  ### Training results
48