marinone94 commited on
Commit
5a2e0ff
·
1 Parent(s): def3e6e

Training in progress, step 15500

Browse files
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f60b0a3dafde522c5a6b5ac7a71b63c5a062b10320a1ea08fc771af880564ca3
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d44272faf59b5eb45a69995b1d6aabe48479f42ec2de68390a38fe5611c6d6ff
3
  size 1262075377
wandb/run-20220127_103723-scy0vyln/files/output.log CHANGED
@@ -11642,3 +11642,388 @@ Configuration saved in ./checkpoint-12000/preprocessor_config.json
11642
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11643
  {'eval_loss': 0.22326770424842834, 'eval_wer': 0.17949580860307165, 'eval_runtime': 129.9475, 'eval_samples_per_second': 35.553, 'eval_steps_per_second': 4.448, 'epoch': 43.6}
11644
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11642
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11643
  {'eval_loss': 0.22326770424842834, 'eval_wer': 0.17949580860307165, 'eval_runtime': 129.9475, 'eval_samples_per_second': 35.553, 'eval_steps_per_second': 4.448, 'epoch': 43.6}
11644
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11645
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11646
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11647
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11648
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11649
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11650
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11651
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11652
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11653
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11654
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11655
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11656
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11657
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11658
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11659
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11660
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11661
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11662
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11663
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11664
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11665
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11666
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11667
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11668
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11669
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11670
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11671
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11672
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11673
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11674
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11675
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11676
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11677
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11678
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11679
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11680
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11681
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11682
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11683
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11684
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11685
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11686
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11687
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11688
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11689
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11690
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11691
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11692
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11693
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11694
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11695
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11696
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11697
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11698
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11699
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11700
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11701
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11702
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11703
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11704
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11705
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11706
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11707
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11708
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11709
+ {'loss': 1.0303, 'learning_rate': 1.0401315789473685e-05, 'epoch': 43.89}
11710
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11711
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11712
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11713
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11714
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11715
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11716
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11717
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11718
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11719
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11720
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11721
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11722
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11723
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11724
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11725
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11726
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11727
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11728
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11729
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11730
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11731
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11732
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11733
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11734
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11735
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11736
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11737
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11738
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11739
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11740
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11741
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11742
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11743
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11744
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11745
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11746
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11747
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11748
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11749
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11750
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11751
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11752
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11753
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11754
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11755
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11756
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11757
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11758
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11759
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11760
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11761
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11762
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11763
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11764
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11765
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11766
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11767
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11768
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11769
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11770
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11771
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11772
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11773
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11774
+ {'loss': 1.0099, 'learning_rate': 9.912828947368419e-06, 'epoch': 44.19}
11775
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11776
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11777
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11778
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11779
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11780
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11781
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11782
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11783
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11784
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11785
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11786
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11787
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11788
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11789
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11790
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11791
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11792
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11793
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11794
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11795
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11796
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11797
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11798
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11799
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11800
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11801
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11802
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11803
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11804
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11805
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11806
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11807
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11808
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11809
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11810
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11811
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11812
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11813
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11814
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11815
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11816
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11817
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11818
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11819
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11820
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11821
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11822
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11823
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11824
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11825
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11826
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11827
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11828
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11829
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11830
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11831
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11832
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11833
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11834
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11835
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11836
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11837
+ {'loss': 1.0098, 'learning_rate': 9.41940789473684e-06, 'epoch': 44.48}
11838
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11839
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11840
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11841
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11842
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11843
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11844
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11845
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11846
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11847
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11848
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11849
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11850
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11851
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11852
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11853
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11854
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11855
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11856
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11857
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11858
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11859
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11860
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11861
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11862
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11863
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11864
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11865
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11866
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11867
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11868
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11869
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11870
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11871
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11872
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11873
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11874
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11875
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11876
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11877
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11878
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11879
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11880
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11881
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11882
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11883
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11884
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11885
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11886
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11887
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11888
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11889
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11890
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11891
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11892
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11893
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11894
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11895
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11896
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11897
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11898
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11899
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11900
+ {'loss': 1.0068, 'learning_rate': 8.925986842105263e-06, 'epoch': 44.77}
11901
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11902
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11903
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11904
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11905
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11906
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11907
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11908
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11909
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11910
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11911
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11912
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11913
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11914
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11915
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11916
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11917
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11918
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11919
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11920
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11921
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11922
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11923
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11924
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11925
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11926
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11927
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11928
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11929
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11930
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11931
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11932
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11933
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11934
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11935
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11936
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11937
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11938
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11939
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11940
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11941
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11942
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11943
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11944
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11945
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11946
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11947
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11948
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11949
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11950
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11951
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11952
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11953
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11954
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11955
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11956
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11957
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11958
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11959
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11960
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11961
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11962
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11963
+ {'loss': 1.0135, 'learning_rate': 8.432565789473683e-06, 'epoch': 45.06}
11964
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11965
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11966
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11967
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11968
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11969
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11970
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11971
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11972
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11973
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11974
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11975
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11976
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11977
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11978
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11979
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11980
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11981
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11982
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11983
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11984
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11985
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11986
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11987
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11988
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11989
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11990
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11991
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11992
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11993
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11994
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11995
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11996
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11997
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11998
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
11999
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12000
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12001
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12002
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12003
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12004
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12005
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12006
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12007
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12008
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12009
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12010
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12011
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12012
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12013
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12014
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12015
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12016
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12017
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12018
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12019
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12020
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12021
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12022
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12023
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12024
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12025
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12026
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12027
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12028
+ {'eval_loss': 0.2199595868587494, 'eval_wer': 0.1794346203267454, 'eval_runtime': 129.6997, 'eval_samples_per_second': 35.621, 'eval_steps_per_second': 4.456, 'epoch': 45.06}
12029
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220127_103723-scy0vyln/logs/debug-internal.log CHANGED
@@ -17697,3 +17697,549 @@
17697
  2022-01-27 17:46:00,383 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17698
  2022-01-27 17:46:00,384 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17699
  2022-01-27 17:46:08,749 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17697
  2022-01-27 17:46:00,383 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17698
  2022-01-27 17:46:00,384 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17699
  2022-01-27 17:46:08,749 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17700
+ 2022-01-27 17:46:15,562 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17701
+ 2022-01-27 17:46:15,563 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17702
+ 2022-01-27 17:46:15,639 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17703
+ 2022-01-27 17:46:17,640 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17704
+ 2022-01-27 17:46:19,641 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17705
+ 2022-01-27 17:46:21,642 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17706
+ 2022-01-27 17:46:23,644 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17707
+ 2022-01-27 17:46:25,645 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17708
+ 2022-01-27 17:46:27,647 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17709
+ 2022-01-27 17:46:29,648 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17710
+ 2022-01-27 17:46:30,795 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17711
+ 2022-01-27 17:46:30,795 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17712
+ 2022-01-27 17:46:31,653 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17713
+ 2022-01-27 17:46:33,655 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17714
+ 2022-01-27 17:46:35,656 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17715
+ 2022-01-27 17:46:37,658 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17716
+ 2022-01-27 17:46:38,962 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17717
+ 2022-01-27 17:46:39,660 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17718
+ 2022-01-27 17:46:41,664 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17719
+ 2022-01-27 17:46:43,666 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17720
+ 2022-01-27 17:46:45,668 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17721
+ 2022-01-27 17:46:45,967 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17722
+ 2022-01-27 17:46:45,967 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17723
+ 2022-01-27 17:46:47,670 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17724
+ 2022-01-27 17:46:49,672 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17725
+ 2022-01-27 17:46:51,674 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17726
+ 2022-01-27 17:46:53,676 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17727
+ 2022-01-27 17:46:55,678 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17728
+ 2022-01-27 17:46:57,680 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17729
+ 2022-01-27 17:46:59,681 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17730
+ 2022-01-27 17:47:01,150 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17731
+ 2022-01-27 17:47:01,151 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17732
+ 2022-01-27 17:47:01,683 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17733
+ 2022-01-27 17:47:03,685 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17734
+ 2022-01-27 17:47:05,687 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17735
+ 2022-01-27 17:47:07,689 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17736
+ 2022-01-27 17:47:09,202 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17737
+ 2022-01-27 17:47:09,691 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17738
+ 2022-01-27 17:47:11,693 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17739
+ 2022-01-27 17:47:13,695 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17740
+ 2022-01-27 17:47:15,696 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17741
+ 2022-01-27 17:47:16,389 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17742
+ 2022-01-27 17:47:16,390 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17743
+ 2022-01-27 17:47:17,698 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17744
+ 2022-01-27 17:47:19,700 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17745
+ 2022-01-27 17:47:21,702 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17746
+ 2022-01-27 17:47:23,704 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17747
+ 2022-01-27 17:47:25,706 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17748
+ 2022-01-27 17:47:27,708 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17749
+ 2022-01-27 17:47:29,709 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17750
+ 2022-01-27 17:47:31,616 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17751
+ 2022-01-27 17:47:31,617 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17752
+ 2022-01-27 17:47:31,711 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17753
+ 2022-01-27 17:47:33,712 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17754
+ 2022-01-27 17:47:35,714 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17755
+ 2022-01-27 17:47:37,716 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17756
+ 2022-01-27 17:47:39,415 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17757
+ 2022-01-27 17:47:39,718 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17758
+ 2022-01-27 17:47:41,720 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17759
+ 2022-01-27 17:47:43,723 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17760
+ 2022-01-27 17:47:45,725 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17761
+ 2022-01-27 17:47:46,873 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17762
+ 2022-01-27 17:47:46,874 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17763
+ 2022-01-27 17:47:47,726 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17764
+ 2022-01-27 17:47:49,728 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17765
+ 2022-01-27 17:47:51,730 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17766
+ 2022-01-27 17:47:53,732 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17767
+ 2022-01-27 17:47:55,734 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17768
+ 2022-01-27 17:47:57,735 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17769
+ 2022-01-27 17:47:59,737 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17770
+ 2022-01-27 17:48:01,739 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17771
+ 2022-01-27 17:48:02,038 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17772
+ 2022-01-27 17:48:02,038 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17773
+ 2022-01-27 17:48:03,741 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17774
+ 2022-01-27 17:48:05,743 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17775
+ 2022-01-27 17:48:07,745 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17776
+ 2022-01-27 17:48:09,642 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17777
+ 2022-01-27 17:48:09,747 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17778
+ 2022-01-27 17:48:11,749 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17779
+ 2022-01-27 17:48:13,753 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17780
+ 2022-01-27 17:48:15,756 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17781
+ 2022-01-27 17:48:17,261 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17782
+ 2022-01-27 17:48:17,262 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17783
+ 2022-01-27 17:48:17,758 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17784
+ 2022-01-27 17:48:19,759 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17785
+ 2022-01-27 17:48:20,264 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
17786
+ 2022-01-27 17:48:20,370 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
17787
+ 2022-01-27 17:48:20,413 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
17788
+ 2022-01-27 17:48:20,760 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
17789
+ 2022-01-27 17:48:21,762 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17790
+ 2022-01-27 17:48:23,764 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17791
+ 2022-01-27 17:48:25,766 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17792
+ 2022-01-27 17:48:27,768 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17793
+ 2022-01-27 17:48:29,770 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17794
+ 2022-01-27 17:48:32,620 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17795
+ 2022-01-27 17:48:32,621 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17796
+ 2022-01-27 17:48:32,771 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17797
+ 2022-01-27 17:48:34,773 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17798
+ 2022-01-27 17:48:36,774 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17799
+ 2022-01-27 17:48:38,775 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17800
+ 2022-01-27 17:48:39,878 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17801
+ 2022-01-27 17:48:40,776 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17802
+ 2022-01-27 17:48:42,778 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17803
+ 2022-01-27 17:48:44,779 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17804
+ 2022-01-27 17:48:46,780 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17805
+ 2022-01-27 17:48:47,790 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17806
+ 2022-01-27 17:48:47,791 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17807
+ 2022-01-27 17:48:48,782 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17808
+ 2022-01-27 17:48:50,783 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17809
+ 2022-01-27 17:48:52,784 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17810
+ 2022-01-27 17:48:54,785 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17811
+ 2022-01-27 17:48:56,787 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17812
+ 2022-01-27 17:48:58,788 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17813
+ 2022-01-27 17:49:00,789 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17814
+ 2022-01-27 17:49:02,791 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17815
+ 2022-01-27 17:49:03,085 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17816
+ 2022-01-27 17:49:03,085 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17817
+ 2022-01-27 17:49:04,792 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17818
+ 2022-01-27 17:49:06,793 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17819
+ 2022-01-27 17:49:08,795 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17820
+ 2022-01-27 17:49:10,092 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17821
+ 2022-01-27 17:49:10,796 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17822
+ 2022-01-27 17:49:12,797 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17823
+ 2022-01-27 17:49:14,799 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17824
+ 2022-01-27 17:49:16,800 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17825
+ 2022-01-27 17:49:18,302 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17826
+ 2022-01-27 17:49:18,303 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17827
+ 2022-01-27 17:49:18,802 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17828
+ 2022-01-27 17:49:20,803 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17829
+ 2022-01-27 17:49:22,804 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17830
+ 2022-01-27 17:49:24,805 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17831
+ 2022-01-27 17:49:26,807 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17832
+ 2022-01-27 17:49:28,808 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17833
+ 2022-01-27 17:49:30,810 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17834
+ 2022-01-27 17:49:32,811 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17835
+ 2022-01-27 17:49:33,505 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17836
+ 2022-01-27 17:49:33,505 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17837
+ 2022-01-27 17:49:34,812 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17838
+ 2022-01-27 17:49:36,813 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17839
+ 2022-01-27 17:49:38,814 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17840
+ 2022-01-27 17:49:40,310 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17841
+ 2022-01-27 17:49:40,815 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17842
+ 2022-01-27 17:49:42,816 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17843
+ 2022-01-27 17:49:44,818 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17844
+ 2022-01-27 17:49:46,819 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17845
+ 2022-01-27 17:49:48,685 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17846
+ 2022-01-27 17:49:48,685 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17847
+ 2022-01-27 17:49:48,820 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17848
+ 2022-01-27 17:49:50,821 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17849
+ 2022-01-27 17:49:52,822 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17850
+ 2022-01-27 17:49:54,824 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17851
+ 2022-01-27 17:49:56,824 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17852
+ 2022-01-27 17:49:58,826 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17853
+ 2022-01-27 17:50:00,828 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17854
+ 2022-01-27 17:50:02,829 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17855
+ 2022-01-27 17:50:03,912 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17856
+ 2022-01-27 17:50:03,913 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17857
+ 2022-01-27 17:50:04,830 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17858
+ 2022-01-27 17:50:06,831 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17859
+ 2022-01-27 17:50:08,833 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17860
+ 2022-01-27 17:50:10,535 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17861
+ 2022-01-27 17:50:10,834 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17862
+ 2022-01-27 17:50:12,835 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17863
+ 2022-01-27 17:50:14,836 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17864
+ 2022-01-27 17:50:16,837 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17865
+ 2022-01-27 17:50:18,838 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17866
+ 2022-01-27 17:50:19,088 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17867
+ 2022-01-27 17:50:19,089 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17868
+ 2022-01-27 17:50:20,840 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17869
+ 2022-01-27 17:50:22,841 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17870
+ 2022-01-27 17:50:24,842 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17871
+ 2022-01-27 17:50:26,843 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17872
+ 2022-01-27 17:50:27,993 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
17873
+ 2022-01-27 17:50:28,081 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
17874
+ 2022-01-27 17:50:28,111 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
17875
+ 2022-01-27 17:50:28,845 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
17876
+ 2022-01-27 17:50:28,845 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17877
+ 2022-01-27 17:50:30,846 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17878
+ 2022-01-27 17:50:33,848 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17879
+ 2022-01-27 17:50:34,353 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17880
+ 2022-01-27 17:50:34,354 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17881
+ 2022-01-27 17:50:35,850 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17882
+ 2022-01-27 17:50:37,851 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17883
+ 2022-01-27 17:50:39,853 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17884
+ 2022-01-27 17:50:40,749 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17885
+ 2022-01-27 17:50:41,854 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17886
+ 2022-01-27 17:50:43,855 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17887
+ 2022-01-27 17:50:45,857 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17888
+ 2022-01-27 17:50:47,858 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17889
+ 2022-01-27 17:50:49,566 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17890
+ 2022-01-27 17:50:49,566 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17891
+ 2022-01-27 17:50:49,859 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17892
+ 2022-01-27 17:50:51,861 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17893
+ 2022-01-27 17:50:53,862 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17894
+ 2022-01-27 17:50:55,863 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17895
+ 2022-01-27 17:50:57,865 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17896
+ 2022-01-27 17:50:59,866 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17897
+ 2022-01-27 17:51:01,867 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17898
+ 2022-01-27 17:51:03,869 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17899
+ 2022-01-27 17:51:04,771 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17900
+ 2022-01-27 17:51:04,771 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17901
+ 2022-01-27 17:51:05,871 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17902
+ 2022-01-27 17:51:07,872 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17903
+ 2022-01-27 17:51:09,873 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17904
+ 2022-01-27 17:51:10,971 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17905
+ 2022-01-27 17:51:11,874 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17906
+ 2022-01-27 17:51:13,876 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17907
+ 2022-01-27 17:51:15,877 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17908
+ 2022-01-27 17:51:17,879 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17909
+ 2022-01-27 17:51:19,881 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17910
+ 2022-01-27 17:51:19,977 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17911
+ 2022-01-27 17:51:19,978 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17912
+ 2022-01-27 17:51:21,882 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17913
+ 2022-01-27 17:51:23,883 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17914
+ 2022-01-27 17:51:25,884 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17915
+ 2022-01-27 17:51:27,886 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17916
+ 2022-01-27 17:51:29,887 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17917
+ 2022-01-27 17:51:31,889 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17918
+ 2022-01-27 17:51:33,890 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17919
+ 2022-01-27 17:51:35,560 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17920
+ 2022-01-27 17:51:35,560 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17921
+ 2022-01-27 17:51:35,892 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17922
+ 2022-01-27 17:51:37,893 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17923
+ 2022-01-27 17:51:39,895 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17924
+ 2022-01-27 17:51:41,190 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17925
+ 2022-01-27 17:51:41,896 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17926
+ 2022-01-27 17:51:43,897 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17927
+ 2022-01-27 17:51:45,899 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17928
+ 2022-01-27 17:51:47,901 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17929
+ 2022-01-27 17:51:49,902 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17930
+ 2022-01-27 17:51:50,828 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17931
+ 2022-01-27 17:51:50,829 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17932
+ 2022-01-27 17:51:51,903 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17933
+ 2022-01-27 17:51:53,905 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17934
+ 2022-01-27 17:51:55,906 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17935
+ 2022-01-27 17:51:57,908 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17936
+ 2022-01-27 17:51:59,909 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17937
+ 2022-01-27 17:52:01,911 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17938
+ 2022-01-27 17:52:03,912 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17939
+ 2022-01-27 17:52:05,914 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17940
+ 2022-01-27 17:52:06,069 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17941
+ 2022-01-27 17:52:06,069 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17942
+ 2022-01-27 17:52:07,915 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17943
+ 2022-01-27 17:52:09,916 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17944
+ 2022-01-27 17:52:11,417 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17945
+ 2022-01-27 17:52:11,917 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17946
+ 2022-01-27 17:52:13,919 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17947
+ 2022-01-27 17:52:15,920 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17948
+ 2022-01-27 17:52:17,921 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17949
+ 2022-01-27 17:52:19,922 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17950
+ 2022-01-27 17:52:21,325 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17951
+ 2022-01-27 17:52:21,325 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17952
+ 2022-01-27 17:52:21,924 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17953
+ 2022-01-27 17:52:23,925 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17954
+ 2022-01-27 17:52:25,926 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17955
+ 2022-01-27 17:52:27,928 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17956
+ 2022-01-27 17:52:29,929 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17957
+ 2022-01-27 17:52:31,931 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17958
+ 2022-01-27 17:52:33,338 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
17959
+ 2022-01-27 17:52:33,426 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
17960
+ 2022-01-27 17:52:33,474 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
17961
+ 2022-01-27 17:52:33,932 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
17962
+ 2022-01-27 17:52:33,932 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17963
+ 2022-01-27 17:52:34,933 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17964
+ 2022-01-27 17:52:35,933 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17965
+ 2022-01-27 17:52:36,528 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17966
+ 2022-01-27 17:52:36,529 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17967
+ 2022-01-27 17:52:37,934 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17968
+ 2022-01-27 17:52:39,936 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17969
+ 2022-01-27 17:52:41,695 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17970
+ 2022-01-27 17:52:41,937 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17971
+ 2022-01-27 17:52:43,938 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17972
+ 2022-01-27 17:52:46,940 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17973
+ 2022-01-27 17:52:48,942 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17974
+ 2022-01-27 17:52:50,943 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17975
+ 2022-01-27 17:52:51,738 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17976
+ 2022-01-27 17:52:51,739 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17977
+ 2022-01-27 17:52:52,944 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17978
+ 2022-01-27 17:52:54,946 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17979
+ 2022-01-27 17:52:56,947 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17980
+ 2022-01-27 17:52:58,948 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17981
+ 2022-01-27 17:53:00,950 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17982
+ 2022-01-27 17:53:02,951 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17983
+ 2022-01-27 17:53:04,952 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17984
+ 2022-01-27 17:53:06,954 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17985
+ 2022-01-27 17:53:06,954 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17986
+ 2022-01-27 17:53:06,959 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17987
+ 2022-01-27 17:53:08,960 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17988
+ 2022-01-27 17:53:10,961 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17989
+ 2022-01-27 17:53:11,919 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
17990
+ 2022-01-27 17:53:12,962 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17991
+ 2022-01-27 17:53:14,964 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17992
+ 2022-01-27 17:53:16,965 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17993
+ 2022-01-27 17:53:18,966 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17994
+ 2022-01-27 17:53:20,967 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17995
+ 2022-01-27 17:53:22,155 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
17996
+ 2022-01-27 17:53:22,156 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
17997
+ 2022-01-27 17:53:22,969 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17998
+ 2022-01-27 17:53:24,970 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
17999
+ 2022-01-27 17:53:26,972 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18000
+ 2022-01-27 17:53:28,973 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18001
+ 2022-01-27 17:53:30,975 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18002
+ 2022-01-27 17:53:32,976 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18003
+ 2022-01-27 17:53:34,977 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18004
+ 2022-01-27 17:53:36,978 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18005
+ 2022-01-27 17:53:37,334 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18006
+ 2022-01-27 17:53:37,335 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18007
+ 2022-01-27 17:53:38,980 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18008
+ 2022-01-27 17:53:40,981 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18009
+ 2022-01-27 17:53:42,153 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18010
+ 2022-01-27 17:53:42,983 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18011
+ 2022-01-27 17:53:44,984 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18012
+ 2022-01-27 17:53:46,985 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18013
+ 2022-01-27 17:53:48,987 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18014
+ 2022-01-27 17:53:50,988 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18015
+ 2022-01-27 17:53:52,508 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18016
+ 2022-01-27 17:53:52,509 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18017
+ 2022-01-27 17:53:52,989 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18018
+ 2022-01-27 17:53:54,991 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18019
+ 2022-01-27 17:53:56,992 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18020
+ 2022-01-27 17:53:58,993 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18021
+ 2022-01-27 17:54:00,994 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18022
+ 2022-01-27 17:54:02,995 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18023
+ 2022-01-27 17:54:04,997 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18024
+ 2022-01-27 17:54:06,998 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18025
+ 2022-01-27 17:54:07,738 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18026
+ 2022-01-27 17:54:07,738 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18027
+ 2022-01-27 17:54:08,999 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18028
+ 2022-01-27 17:54:11,001 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18029
+ 2022-01-27 17:54:12,361 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18030
+ 2022-01-27 17:54:13,002 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18031
+ 2022-01-27 17:54:15,003 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18032
+ 2022-01-27 17:54:17,004 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18033
+ 2022-01-27 17:54:19,006 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18034
+ 2022-01-27 17:54:21,007 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18035
+ 2022-01-27 17:54:22,964 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18036
+ 2022-01-27 17:54:22,965 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18037
+ 2022-01-27 17:54:24,010 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18038
+ 2022-01-27 17:54:26,011 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18039
+ 2022-01-27 17:54:28,012 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18040
+ 2022-01-27 17:54:30,014 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18041
+ 2022-01-27 17:54:32,015 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18042
+ 2022-01-27 17:54:34,016 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18043
+ 2022-01-27 17:54:36,018 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18044
+ 2022-01-27 17:54:38,019 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18045
+ 2022-01-27 17:54:38,151 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18046
+ 2022-01-27 17:54:38,152 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18047
+ 2022-01-27 17:54:38,435 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
18048
+ 2022-01-27 17:54:38,527 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
18049
+ 2022-01-27 17:54:38,558 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
18050
+ 2022-01-27 17:54:39,020 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
18051
+ 2022-01-27 17:54:40,021 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18052
+ 2022-01-27 17:54:41,021 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18053
+ 2022-01-27 17:54:42,022 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18054
+ 2022-01-27 17:54:42,607 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18055
+ 2022-01-27 17:54:44,023 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18056
+ 2022-01-27 17:54:46,024 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18057
+ 2022-01-27 17:54:48,025 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18058
+ 2022-01-27 17:54:50,027 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18059
+ 2022-01-27 17:54:52,028 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18060
+ 2022-01-27 17:54:53,321 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18061
+ 2022-01-27 17:54:53,322 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18062
+ 2022-01-27 17:54:54,030 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18063
+ 2022-01-27 17:54:56,031 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18064
+ 2022-01-27 17:54:58,032 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18065
+ 2022-01-27 17:55:00,033 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18066
+ 2022-01-27 17:55:02,035 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18067
+ 2022-01-27 17:55:04,036 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18068
+ 2022-01-27 17:55:06,038 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18069
+ 2022-01-27 17:55:08,039 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18070
+ 2022-01-27 17:55:08,555 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18071
+ 2022-01-27 17:55:08,555 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18072
+ 2022-01-27 17:55:10,040 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18073
+ 2022-01-27 17:55:12,042 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18074
+ 2022-01-27 17:55:12,821 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18075
+ 2022-01-27 17:55:14,044 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18076
+ 2022-01-27 17:55:16,045 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18077
+ 2022-01-27 17:55:18,046 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18078
+ 2022-01-27 17:55:20,048 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18079
+ 2022-01-27 17:55:22,049 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18080
+ 2022-01-27 17:55:23,798 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18081
+ 2022-01-27 17:55:23,799 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18082
+ 2022-01-27 17:55:24,050 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18083
+ 2022-01-27 17:55:26,051 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18084
+ 2022-01-27 17:55:28,052 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18085
+ 2022-01-27 17:55:30,054 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18086
+ 2022-01-27 17:55:32,055 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18087
+ 2022-01-27 17:55:34,056 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18088
+ 2022-01-27 17:55:36,057 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18089
+ 2022-01-27 17:55:38,058 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18090
+ 2022-01-27 17:55:38,977 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18091
+ 2022-01-27 17:55:38,978 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18092
+ 2022-01-27 17:55:40,059 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18093
+ 2022-01-27 17:55:42,060 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18094
+ 2022-01-27 17:55:43,028 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18095
+ 2022-01-27 17:55:44,062 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18096
+ 2022-01-27 17:55:46,063 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18097
+ 2022-01-27 17:55:48,064 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18098
+ 2022-01-27 17:55:50,065 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18099
+ 2022-01-27 17:55:52,067 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18100
+ 2022-01-27 17:55:54,068 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18101
+ 2022-01-27 17:55:54,202 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18102
+ 2022-01-27 17:55:54,203 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18103
+ 2022-01-27 17:55:56,070 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18104
+ 2022-01-27 17:55:58,071 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18105
+ 2022-01-27 17:56:00,073 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18106
+ 2022-01-27 17:56:02,074 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18107
+ 2022-01-27 17:56:04,075 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18108
+ 2022-01-27 17:56:06,077 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18109
+ 2022-01-27 17:56:08,078 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18110
+ 2022-01-27 17:56:09,441 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18111
+ 2022-01-27 17:56:09,441 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18112
+ 2022-01-27 17:56:10,079 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18113
+ 2022-01-27 17:56:12,081 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18114
+ 2022-01-27 17:56:13,256 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18115
+ 2022-01-27 17:56:14,082 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18116
+ 2022-01-27 17:56:18,084 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18117
+ 2022-01-27 17:56:20,085 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18118
+ 2022-01-27 17:56:23,087 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18119
+ 2022-01-27 17:56:24,627 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18120
+ 2022-01-27 17:56:24,627 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18121
+ 2022-01-27 17:56:25,089 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18122
+ 2022-01-27 17:56:27,090 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18123
+ 2022-01-27 17:56:29,092 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18124
+ 2022-01-27 17:56:31,093 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18125
+ 2022-01-27 17:56:33,095 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18126
+ 2022-01-27 17:56:35,096 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18127
+ 2022-01-27 17:56:37,097 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18128
+ 2022-01-27 17:56:39,099 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18129
+ 2022-01-27 17:56:39,891 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18130
+ 2022-01-27 17:56:39,892 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18131
+ 2022-01-27 17:56:41,100 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18132
+ 2022-01-27 17:56:43,101 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18133
+ 2022-01-27 17:56:43,469 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18134
+ 2022-01-27 17:56:45,102 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18135
+ 2022-01-27 17:56:45,189 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
18136
+ 2022-01-27 17:56:45,267 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
18137
+ 2022-01-27 17:56:45,314 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
18138
+ 2022-01-27 17:56:46,103 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
18139
+ 2022-01-27 17:56:47,104 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18140
+ 2022-01-27 17:56:48,104 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18141
+ 2022-01-27 17:56:49,105 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18142
+ 2022-01-27 17:56:51,107 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18143
+ 2022-01-27 17:56:53,108 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18144
+ 2022-01-27 17:56:55,066 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18145
+ 2022-01-27 17:56:55,066 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18146
+ 2022-01-27 17:56:55,109 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18147
+ 2022-01-27 17:56:57,111 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18148
+ 2022-01-27 17:56:59,112 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18149
+ 2022-01-27 17:57:01,113 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18150
+ 2022-01-27 17:57:03,115 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18151
+ 2022-01-27 17:57:05,116 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18152
+ 2022-01-27 17:57:07,118 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18153
+ 2022-01-27 17:57:09,119 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18154
+ 2022-01-27 17:57:10,358 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18155
+ 2022-01-27 17:57:10,358 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18156
+ 2022-01-27 17:57:11,120 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18157
+ 2022-01-27 17:57:13,121 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18158
+ 2022-01-27 17:57:13,716 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18159
+ 2022-01-27 17:57:15,123 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18160
+ 2022-01-27 17:57:17,124 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18161
+ 2022-01-27 17:57:19,125 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18162
+ 2022-01-27 17:57:21,127 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18163
+ 2022-01-27 17:57:23,128 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18164
+ 2022-01-27 17:57:25,129 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18165
+ 2022-01-27 17:57:25,557 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18166
+ 2022-01-27 17:57:25,557 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18167
+ 2022-01-27 17:57:27,131 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18168
+ 2022-01-27 17:57:29,132 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18169
+ 2022-01-27 17:57:31,133 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18170
+ 2022-01-27 17:57:33,135 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18171
+ 2022-01-27 17:57:36,137 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18172
+ 2022-01-27 17:57:38,139 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18173
+ 2022-01-27 17:57:40,140 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18174
+ 2022-01-27 17:57:40,732 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18175
+ 2022-01-27 17:57:40,732 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18176
+ 2022-01-27 17:57:42,141 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18177
+ 2022-01-27 17:57:43,936 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18178
+ 2022-01-27 17:57:44,143 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18179
+ 2022-01-27 17:57:46,144 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18180
+ 2022-01-27 17:57:48,146 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18181
+ 2022-01-27 17:57:50,147 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18182
+ 2022-01-27 17:57:52,148 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18183
+ 2022-01-27 17:57:54,150 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18184
+ 2022-01-27 17:57:55,958 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18185
+ 2022-01-27 17:57:55,959 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18186
+ 2022-01-27 17:57:56,151 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18187
+ 2022-01-27 17:57:58,154 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18188
+ 2022-01-27 17:58:00,155 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18189
+ 2022-01-27 17:58:02,157 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18190
+ 2022-01-27 17:58:04,158 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18191
+ 2022-01-27 17:58:06,159 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18192
+ 2022-01-27 17:58:08,161 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18193
+ 2022-01-27 17:58:10,162 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18194
+ 2022-01-27 17:58:11,153 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18195
+ 2022-01-27 17:58:11,154 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18196
+ 2022-01-27 17:58:12,163 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18197
+ 2022-01-27 17:58:14,163 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18198
+ 2022-01-27 17:58:14,167 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18199
+ 2022-01-27 17:58:16,168 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18200
+ 2022-01-27 17:58:18,170 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18201
+ 2022-01-27 17:58:20,171 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18202
+ 2022-01-27 17:58:22,173 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18203
+ 2022-01-27 17:58:24,174 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18204
+ 2022-01-27 17:58:26,175 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18205
+ 2022-01-27 17:58:26,353 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18206
+ 2022-01-27 17:58:26,354 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18207
+ 2022-01-27 17:58:28,177 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18208
+ 2022-01-27 17:58:30,178 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18209
+ 2022-01-27 17:58:32,180 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18210
+ 2022-01-27 17:58:34,181 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18211
+ 2022-01-27 17:58:36,182 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18212
+ 2022-01-27 17:58:38,184 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18213
+ 2022-01-27 17:58:40,185 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18214
+ 2022-01-27 17:58:41,584 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18215
+ 2022-01-27 17:58:41,585 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18216
+ 2022-01-27 17:58:42,187 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18217
+ 2022-01-27 17:58:44,188 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18218
+ 2022-01-27 17:58:44,394 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18219
+ 2022-01-27 17:58:46,190 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18220
+ 2022-01-27 17:58:48,191 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18221
+ 2022-01-27 17:58:50,192 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18222
+ 2022-01-27 17:58:52,194 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18223
+ 2022-01-27 17:58:54,195 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18224
+ 2022-01-27 17:58:54,856 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
18225
+ 2022-01-27 17:58:54,890 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
18226
+ 2022-01-27 17:58:54,937 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
18227
+ 2022-01-27 17:58:55,196 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
18228
+ 2022-01-27 17:58:56,197 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18229
+ 2022-01-27 17:58:56,754 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18230
+ 2022-01-27 17:58:56,756 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18231
+ 2022-01-27 17:58:58,198 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18232
+ 2022-01-27 17:59:06,205 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18233
+ 2022-01-27 17:59:11,924 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18234
+ 2022-01-27 17:59:11,925 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18235
+ 2022-01-27 17:59:14,622 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18236
+ 2022-01-27 17:59:27,148 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18237
+ 2022-01-27 17:59:27,148 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18238
+ 2022-01-27 17:59:42,318 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18239
+ 2022-01-27 17:59:42,319 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18240
+ 2022-01-27 17:59:44,860 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18241
+ 2022-01-27 17:59:57,619 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18242
+ 2022-01-27 17:59:57,620 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18243
+ 2022-01-27 18:00:12,797 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18244
+ 2022-01-27 18:00:12,798 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18245
+ 2022-01-27 18:00:15,117 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
wandb/run-20220127_103723-scy0vyln/run-scy0vyln.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:85248c2ab21c456e4c9579cf54a27aa405c2e646bab9ac4a62c8fe33f5dc103a
3
- size 102776792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c884b7dc88a712ca8f65aaeae6b7e07185adb441c33bf9da6a8ba5dc814591d3
3
+ size 106197702