Hugging Face's logo

AlexN
/
xls-r-300m-fr

Automatic Speech Recognition
Transformers
PyTorch
French
wav2vec2
Generated from Trainer
hf-asr-leaderboard
mozilla-foundation/common_voice_8_0
robust-speech-event
Eval Results
Inference Endpoints
Model card Files Community
1
AlexN commited on
Commit
bf4f1e4
·
1 Parent(s): cca66bf

Model save

Browse files
Files changed (6) hide show
  1. pytorch_model.bin +1 -1
  2. wandb/run-20220130_191954-1mtmnz5y/files/config.yaml +20 -0
  3. wandb/run-20220130_191954-1mtmnz5y/files/output.log +365 -0
  4. wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json +0 -0
  5. wandb/run-20220130_191954-1mtmnz5y/logs/debug-internal.log +589 -0
  6. wandb/run-20220130_191954-1mtmnz5y/run-1mtmnz5y.wandb +2 -2
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce448c582da20cef468a048e2572bd0f00fe55a60756c2bad5ce6963a8dbab0c
3
  size 1262821553
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f9c6a7fe50ee84c94a3ae149eea45203dc369fa4e7bcf46fbc4367f2385e4d3
3
  size 1262821553
wandb/run-20220130_191954-1mtmnz5y/files/config.yaml CHANGED
@@ -4802,6 +4802,26 @@ _wandb:
4802
  5: 1
4803
  6:
4804
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4805
  python_version: 3.8.8
4806
  start_time: 1643570395
4807
  t:
 
4802
  5: 1
4803
  6:
4804
  - 1
4805
+ - 1: train/train_runtime
4806
+ 5: 1
4807
+ 6:
4808
+ - 1
4809
+ - 1: train/train_samples_per_second
4810
+ 5: 1
4811
+ 6:
4812
+ - 1
4813
+ - 1: train/train_steps_per_second
4814
+ 5: 1
4815
+ 6:
4816
+ - 1
4817
+ - 1: train/total_flos
4818
+ 5: 1
4819
+ 6:
4820
+ - 1
4821
+ - 1: train/train_loss
4822
+ 5: 1
4823
+ 6:
4824
+ - 1
4825
  python_version: 3.8.8
4826
  start_time: 1643570395
4827
  t:
wandb/run-20220130_191954-1mtmnz5y/files/output.log CHANGED
@@ -31705,3 +31705,368 @@ Configuration saved in ./checkpoint-27000/preprocessor_config.json
31705
  Configuration saved in ./checkpoint-27500/config.json
31706
  Configuration saved in ./checkpoint-27500/preprocessor_config.json
31707
  Configuration saved in ./checkpoint-27500/preprocessor_config.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31705
  Configuration saved in ./checkpoint-27500/config.json
31706
  Configuration saved in ./checkpoint-27500/preprocessor_config.json
31707
  Configuration saved in ./checkpoint-27500/preprocessor_config.json
31708
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31709
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31710
+ 02/01/2022 02:25:33 - WARNING - huggingface_hub.repository - Several commits (51) will be pushed upstream.
31711
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31712
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31713
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31714
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31715
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31716
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31717
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31718
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31719
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31720
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31721
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31722
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31723
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31724
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31725
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31726
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31727
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31728
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31729
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31730
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31731
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31732
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31733
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31734
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31735
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31736
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31737
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31738
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31739
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31740
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31741
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31742
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31743
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31744
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31745
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31746
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31747
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31748
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31749
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31750
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31751
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31752
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31753
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31754
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31755
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31756
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31757
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31758
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31759
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31760
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31761
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31762
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31763
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31764
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31765
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31766
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31767
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31768
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31769
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31770
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31771
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31772
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31773
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31774
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31775
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31776
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31777
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31778
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31779
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31780
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31781
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31782
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31783
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31784
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31785
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31786
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31787
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31788
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31789
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31790
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31791
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31792
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31793
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31794
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31795
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31796
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31797
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31798
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31799
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31800
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31801
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31802
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31803
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31804
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31805
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31806
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31807
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31808
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31809
+ {'loss': 1.5776, 'learning_rate': 1.1248012718600955e-06, 'epoch': 3.96}
31810
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31811
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31812
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31813
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31814
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31815
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31816
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31817
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31818
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31819
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31820
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31821
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31822
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31823
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31824
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31825
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31826
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31827
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31828
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31829
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31830
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31831
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31832
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31833
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31834
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31835
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31836
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31837
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31838
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31839
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31840
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31841
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31842
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31843
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31844
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31845
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31846
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31847
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31848
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31849
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31850
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31851
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31852
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31853
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31854
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31855
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31856
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31857
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31858
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31859
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31860
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31861
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31862
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31863
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31864
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31865
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31866
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31867
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31868
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31869
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31870
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31871
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31872
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31873
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31874
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31875
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31876
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31877
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31878
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31879
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31880
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31881
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31882
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31883
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31884
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31885
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31886
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31887
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31888
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31889
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31890
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31891
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31892
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31893
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31894
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31895
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31896
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31897
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31898
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31899
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31900
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31901
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31902
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31903
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31904
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31905
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31906
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31907
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31908
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31909
+ {'loss': 1.5486, 'learning_rate': 7.273449920508744e-07, 'epoch': 3.98}
31910
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31911
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31912
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31913
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31914
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31915
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31916
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31917
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31918
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31919
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31920
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31921
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31922
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31923
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31924
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31925
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31926
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31927
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31928
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31929
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31930
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31931
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31932
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31933
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31934
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31935
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31936
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31937
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31938
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31939
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31940
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31941
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31942
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31943
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31944
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31945
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31946
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31947
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31948
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31949
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31950
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31951
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31952
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31953
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31954
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31955
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31956
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31957
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31958
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31959
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31960
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31961
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31962
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31963
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31964
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31965
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31966
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31967
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31968
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31969
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31970
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31971
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31972
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31973
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31974
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31975
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31976
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31977
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31978
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31979
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31980
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31981
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31982
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31983
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31984
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31985
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31986
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31987
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31988
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31989
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31990
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31991
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31992
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31993
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31994
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31995
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31996
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31997
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31998
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
31999
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32000
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32001
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32002
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32003
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32004
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32005
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32006
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32007
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32008
+ {'loss': 1.4093, 'learning_rate': 3.2988871224165346e-07, 'epoch': 3.99}
32009
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32010
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32011
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32012
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32013
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32014
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32015
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32016
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32017
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32018
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32019
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32020
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32021
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32022
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32023
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32024
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32025
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32026
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32027
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32028
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32029
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32030
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32031
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32032
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32033
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32034
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32035
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32036
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32037
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32038
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32039
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32040
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32041
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32042
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32043
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32044
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32045
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32046
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32047
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32048
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32049
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32050
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32051
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32052
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32053
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32054
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32055
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32056
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32057
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32058
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32059
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32060
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32061
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32062
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32063
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32064
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32065
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32066
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32067
+ Configuration saved in ./checkpoint-27500/preprocessor_config.json
32068
+ Loading best model from ./checkpoint-18000 (score: 0.22597630321979523).
32069
+ Loading best model from ./checkpoint-18000 (score: 0.22597630321979523).
32070
+ Saving model checkpoint to ./ckpoint-18000 (score: 0.22597630321979523).
32071
+ Saving model checkpoint to ./rch_model.bin (score: 0.22597630321979523).
32072
+ Model weights saved in ./pytorch_model.bin (score: 0.22597630321979523).
wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220130_191954-1mtmnz5y/logs/debug-internal.log CHANGED
@@ -52410,3 +52410,592 @@
52410
  2022-02-01 02:25:22,239 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52411
  2022-02-01 02:25:22,240 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52412
  2022-02-01 02:25:29,263 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52410
  2022-02-01 02:25:22,239 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52411
  2022-02-01 02:25:22,240 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52412
  2022-02-01 02:25:29,263 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52413
+ 2022-02-01 02:25:34,569 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52414
+ 2022-02-01 02:25:36,570 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52415
+ 2022-02-01 02:25:37,481 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52416
+ 2022-02-01 02:25:37,481 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52417
+ 2022-02-01 02:25:42,574 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52418
+ 2022-02-01 02:25:46,576 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52419
+ 2022-02-01 02:25:50,578 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52420
+ 2022-02-01 02:25:52,871 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52421
+ 2022-02-01 02:25:52,871 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52422
+ 2022-02-01 02:25:54,581 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52423
+ 2022-02-01 02:25:59,560 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52424
+ 2022-02-01 02:26:00,584 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52425
+ 2022-02-01 02:26:04,587 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52426
+ 2022-02-01 02:26:08,134 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52427
+ 2022-02-01 02:26:08,135 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52428
+ 2022-02-01 02:26:08,588 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52429
+ 2022-02-01 02:26:12,590 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52430
+ 2022-02-01 02:26:15,591 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52431
+ 2022-02-01 02:26:19,593 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52432
+ 2022-02-01 02:26:23,403 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52433
+ 2022-02-01 02:26:23,404 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52434
+ 2022-02-01 02:26:23,595 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52435
+ 2022-02-01 02:26:27,598 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52436
+ 2022-02-01 02:26:29,853 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52437
+ 2022-02-01 02:26:31,601 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52438
+ 2022-02-01 02:26:33,602 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52439
+ 2022-02-01 02:26:37,604 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52440
+ 2022-02-01 02:26:38,605 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52441
+ 2022-02-01 02:26:38,605 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52442
+ 2022-02-01 02:26:41,612 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52443
+ 2022-02-01 02:26:43,613 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52444
+ 2022-02-01 02:26:47,616 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52445
+ 2022-02-01 02:26:49,617 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52446
+ 2022-02-01 02:26:53,620 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52447
+ 2022-02-01 02:26:53,771 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52448
+ 2022-02-01 02:26:53,771 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52449
+ 2022-02-01 02:26:55,622 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52450
+ 2022-02-01 02:26:59,625 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52451
+ 2022-02-01 02:27:00,146 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52452
+ 2022-02-01 02:27:01,626 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52453
+ 2022-02-01 02:27:06,629 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52454
+ 2022-02-01 02:27:08,632 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52455
+ 2022-02-01 02:27:08,938 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52456
+ 2022-02-01 02:27:08,939 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52457
+ 2022-02-01 02:27:12,634 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52458
+ 2022-02-01 02:27:14,635 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52459
+ 2022-02-01 02:27:16,637 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52460
+ 2022-02-01 02:27:20,639 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52461
+ 2022-02-01 02:27:22,641 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52462
+ 2022-02-01 02:27:24,165 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52463
+ 2022-02-01 02:27:24,166 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52464
+ 2022-02-01 02:27:24,642 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52465
+ 2022-02-01 02:27:28,645 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52466
+ 2022-02-01 02:27:30,416 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52467
+ 2022-02-01 02:27:30,646 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52468
+ 2022-02-01 02:27:32,648 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52469
+ 2022-02-01 02:27:34,649 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52470
+ 2022-02-01 02:27:36,650 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52471
+ 2022-02-01 02:27:38,651 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52472
+ 2022-02-01 02:27:39,390 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52473
+ 2022-02-01 02:27:39,390 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52474
+ 2022-02-01 02:27:40,653 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52475
+ 2022-02-01 02:27:42,654 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52476
+ 2022-02-01 02:27:44,658 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52477
+ 2022-02-01 02:27:46,659 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52478
+ 2022-02-01 02:27:48,660 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52479
+ 2022-02-01 02:27:50,661 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52480
+ 2022-02-01 02:27:52,663 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52481
+ 2022-02-01 02:27:54,875 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52482
+ 2022-02-01 02:27:54,876 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52483
+ 2022-02-01 02:28:00,710 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52484
+ 2022-02-01 02:28:01,669 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52485
+ 2022-02-01 02:28:07,672 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52486
+ 2022-02-01 02:28:10,225 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52487
+ 2022-02-01 02:28:10,225 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52488
+ 2022-02-01 02:28:13,676 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52489
+ 2022-02-01 02:28:17,678 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52490
+ 2022-02-01 02:28:23,682 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52491
+ 2022-02-01 02:28:25,391 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52492
+ 2022-02-01 02:28:25,391 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52493
+ 2022-02-01 02:28:27,684 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52494
+ 2022-02-01 02:28:30,986 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52495
+ 2022-02-01 02:28:31,688 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52496
+ 2022-02-01 02:28:36,692 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52497
+ 2022-02-01 02:28:40,694 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52498
+ 2022-02-01 02:28:40,696 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52499
+ 2022-02-01 02:28:40,697 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52500
+ 2022-02-01 02:28:44,697 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52501
+ 2022-02-01 02:28:50,701 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52502
+ 2022-02-01 02:28:54,703 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52503
+ 2022-02-01 02:28:56,139 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52504
+ 2022-02-01 02:28:56,139 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52505
+ 2022-02-01 02:28:58,706 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52506
+ 2022-02-01 02:29:01,274 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52507
+ 2022-02-01 02:29:02,709 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52508
+ 2022-02-01 02:29:04,710 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52509
+ 2022-02-01 02:29:08,713 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52510
+ 2022-02-01 02:29:11,421 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52511
+ 2022-02-01 02:29:11,422 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52512
+ 2022-02-01 02:29:12,715 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52513
+ 2022-02-01 02:29:16,717 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52514
+ 2022-02-01 02:29:20,719 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52515
+ 2022-02-01 02:29:22,721 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52516
+ 2022-02-01 02:29:26,723 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52517
+ 2022-02-01 02:29:26,827 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52518
+ 2022-02-01 02:29:26,827 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52519
+ 2022-02-01 02:29:30,725 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52520
+ 2022-02-01 02:29:31,537 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52521
+ 2022-02-01 02:29:33,727 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52522
+ 2022-02-01 02:29:37,730 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52523
+ 2022-02-01 02:29:39,732 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52524
+ 2022-02-01 02:29:42,066 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52525
+ 2022-02-01 02:29:42,066 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52526
+ 2022-02-01 02:29:43,735 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52527
+ 2022-02-01 02:29:47,738 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52528
+ 2022-02-01 02:29:49,740 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52529
+ 2022-02-01 02:29:53,743 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52530
+ 2022-02-01 02:29:55,745 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52531
+ 2022-02-01 02:29:57,407 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52532
+ 2022-02-01 02:29:57,407 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52533
+ 2022-02-01 02:29:57,747 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52534
+ 2022-02-01 02:30:01,750 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52535
+ 2022-02-01 02:30:01,833 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52536
+ 2022-02-01 02:30:03,752 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52537
+ 2022-02-01 02:30:05,754 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52538
+ 2022-02-01 02:30:09,757 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52539
+ 2022-02-01 02:30:11,759 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52540
+ 2022-02-01 02:30:12,721 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52541
+ 2022-02-01 02:30:12,722 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52542
+ 2022-02-01 02:30:13,761 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52543
+ 2022-02-01 02:30:15,763 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52544
+ 2022-02-01 02:30:19,766 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52545
+ 2022-02-01 02:30:21,768 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52546
+ 2022-02-01 02:30:23,769 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52547
+ 2022-02-01 02:30:25,771 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52548
+ 2022-02-01 02:30:27,773 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52549
+ 2022-02-01 02:30:27,911 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52550
+ 2022-02-01 02:30:27,912 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52551
+ 2022-02-01 02:30:29,774 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52552
+ 2022-02-01 02:30:31,776 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52553
+ 2022-02-01 02:30:32,056 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52554
+ 2022-02-01 02:30:33,778 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52555
+ 2022-02-01 02:30:35,779 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52556
+ 2022-02-01 02:30:38,782 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52557
+ 2022-02-01 02:30:40,783 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52558
+ 2022-02-01 02:30:43,097 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52559
+ 2022-02-01 02:30:43,098 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52560
+ 2022-02-01 02:30:48,789 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52561
+ 2022-02-01 02:30:54,792 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52562
+ 2022-02-01 02:30:58,387 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52563
+ 2022-02-01 02:30:58,388 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52564
+ 2022-02-01 02:30:58,795 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52565
+ 2022-02-01 02:31:02,293 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52566
+ 2022-02-01 02:31:04,800 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52567
+ 2022-02-01 02:31:07,436 DEBUG SenderThread:55777 [sender.py:send():234] send: history
52568
+ 2022-02-01 02:31:07,559 DEBUG SenderThread:55777 [sender.py:send():234] send: summary
52569
+ 2022-02-01 02:31:07,606 INFO SenderThread:55777 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
52570
+ 2022-02-01 02:31:07,802 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json
52571
+ 2022-02-01 02:31:08,803 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52572
+ 2022-02-01 02:31:13,841 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52573
+ 2022-02-01 02:31:13,842 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52574
+ 2022-02-01 02:31:14,806 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52575
+ 2022-02-01 02:31:19,810 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52576
+ 2022-02-01 02:31:23,813 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52577
+ 2022-02-01 02:31:27,815 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52578
+ 2022-02-01 02:31:29,150 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52579
+ 2022-02-01 02:31:29,151 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52580
+ 2022-02-01 02:31:31,818 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52581
+ 2022-02-01 02:31:32,552 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52582
+ 2022-02-01 02:31:35,820 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52583
+ 2022-02-01 02:31:39,823 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52584
+ 2022-02-01 02:31:43,825 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52585
+ 2022-02-01 02:31:44,353 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52586
+ 2022-02-01 02:31:44,353 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52587
+ 2022-02-01 02:31:47,828 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52588
+ 2022-02-01 02:31:51,830 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52589
+ 2022-02-01 02:31:55,833 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52590
+ 2022-02-01 02:31:57,835 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52591
+ 2022-02-01 02:31:59,541 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52592
+ 2022-02-01 02:31:59,542 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52593
+ 2022-02-01 02:32:01,837 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52594
+ 2022-02-01 02:32:02,872 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52595
+ 2022-02-01 02:32:06,841 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52596
+ 2022-02-01 02:32:10,843 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52597
+ 2022-02-01 02:32:14,715 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52598
+ 2022-02-01 02:32:14,715 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52599
+ 2022-02-01 02:32:14,846 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52600
+ 2022-02-01 02:32:16,848 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52601
+ 2022-02-01 02:32:20,850 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52602
+ 2022-02-01 02:32:22,852 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52603
+ 2022-02-01 02:32:26,856 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52604
+ 2022-02-01 02:32:28,858 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52605
+ 2022-02-01 02:32:29,996 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52606
+ 2022-02-01 02:32:29,997 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52607
+ 2022-02-01 02:32:32,861 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52608
+ 2022-02-01 02:32:33,187 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52609
+ 2022-02-01 02:32:34,863 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52610
+ 2022-02-01 02:32:38,866 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52611
+ 2022-02-01 02:32:40,868 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52612
+ 2022-02-01 02:32:44,872 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52613
+ 2022-02-01 02:32:45,231 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52614
+ 2022-02-01 02:32:45,232 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52615
+ 2022-02-01 02:32:46,874 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52616
+ 2022-02-01 02:32:48,876 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52617
+ 2022-02-01 02:32:52,879 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52618
+ 2022-02-01 02:32:54,880 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52619
+ 2022-02-01 02:32:56,882 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52620
+ 2022-02-01 02:32:58,884 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52621
+ 2022-02-01 02:33:00,483 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52622
+ 2022-02-01 02:33:00,484 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52623
+ 2022-02-01 02:33:02,887 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52624
+ 2022-02-01 02:33:03,466 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52625
+ 2022-02-01 02:33:04,889 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52626
+ 2022-02-01 02:33:06,890 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52627
+ 2022-02-01 02:33:08,892 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52628
+ 2022-02-01 02:33:10,894 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52629
+ 2022-02-01 02:33:12,896 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52630
+ 2022-02-01 02:33:15,715 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52631
+ 2022-02-01 02:33:15,716 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52632
+ 2022-02-01 02:33:15,898 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52633
+ 2022-02-01 02:33:17,900 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52634
+ 2022-02-01 02:33:19,902 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52635
+ 2022-02-01 02:33:21,904 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52636
+ 2022-02-01 02:33:23,906 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52637
+ 2022-02-01 02:33:25,908 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52638
+ 2022-02-01 02:33:27,910 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52639
+ 2022-02-01 02:33:30,883 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52640
+ 2022-02-01 02:33:30,883 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52641
+ 2022-02-01 02:33:33,829 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52642
+ 2022-02-01 02:33:33,914 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52643
+ 2022-02-01 02:33:39,919 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52644
+ 2022-02-01 02:33:45,922 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52645
+ 2022-02-01 02:33:46,223 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52646
+ 2022-02-01 02:33:46,224 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52647
+ 2022-02-01 02:33:49,925 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52648
+ 2022-02-01 02:33:56,929 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52649
+ 2022-02-01 02:34:00,932 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52650
+ 2022-02-01 02:34:01,425 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52651
+ 2022-02-01 02:34:01,425 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52652
+ 2022-02-01 02:34:04,187 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52653
+ 2022-02-01 02:34:04,935 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52654
+ 2022-02-01 02:34:10,939 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52655
+ 2022-02-01 02:34:14,941 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52656
+ 2022-02-01 02:34:16,653 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52657
+ 2022-02-01 02:34:16,653 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52658
+ 2022-02-01 02:34:18,944 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52659
+ 2022-02-01 02:34:22,947 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52660
+ 2022-02-01 02:34:26,950 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52661
+ 2022-02-01 02:34:30,953 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52662
+ 2022-02-01 02:34:31,919 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52663
+ 2022-02-01 02:34:31,920 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52664
+ 2022-02-01 02:34:34,538 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52665
+ 2022-02-01 02:34:34,955 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52666
+ 2022-02-01 02:34:36,957 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52667
+ 2022-02-01 02:34:40,959 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52668
+ 2022-02-01 02:34:44,962 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52669
+ 2022-02-01 02:34:47,086 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52670
+ 2022-02-01 02:34:47,087 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52671
+ 2022-02-01 02:34:49,965 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52672
+ 2022-02-01 02:34:53,968 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52673
+ 2022-02-01 02:34:55,970 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52674
+ 2022-02-01 02:34:59,972 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52675
+ 2022-02-01 02:35:02,378 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52676
+ 2022-02-01 02:35:02,378 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52677
+ 2022-02-01 02:35:03,974 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52678
+ 2022-02-01 02:35:04,862 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52679
+ 2022-02-01 02:35:05,976 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52680
+ 2022-02-01 02:35:09,979 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52681
+ 2022-02-01 02:35:11,981 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52682
+ 2022-02-01 02:35:15,984 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52683
+ 2022-02-01 02:35:17,728 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52684
+ 2022-02-01 02:35:17,728 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52685
+ 2022-02-01 02:35:17,985 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52686
+ 2022-02-01 02:35:21,988 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52687
+ 2022-02-01 02:35:23,989 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52688
+ 2022-02-01 02:35:27,992 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52689
+ 2022-02-01 02:35:29,993 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52690
+ 2022-02-01 02:35:32,974 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52691
+ 2022-02-01 02:35:32,975 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52692
+ 2022-02-01 02:35:33,996 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52693
+ 2022-02-01 02:35:35,222 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52694
+ 2022-02-01 02:35:35,997 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52695
+ 2022-02-01 02:35:37,998 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52696
+ 2022-02-01 02:35:40,000 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52697
+ 2022-02-01 02:35:44,002 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52698
+ 2022-02-01 02:35:46,003 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52699
+ 2022-02-01 02:35:48,004 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52700
+ 2022-02-01 02:35:48,161 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52701
+ 2022-02-01 02:35:48,162 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52702
+ 2022-02-01 02:35:50,006 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52703
+ 2022-02-01 02:35:53,008 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52704
+ 2022-02-01 02:35:57,010 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52705
+ 2022-02-01 02:35:59,012 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52706
+ 2022-02-01 02:36:01,013 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52707
+ 2022-02-01 02:36:03,015 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52708
+ 2022-02-01 02:36:03,401 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52709
+ 2022-02-01 02:36:03,402 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52710
+ 2022-02-01 02:36:05,016 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52711
+ 2022-02-01 02:36:05,496 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52712
+ 2022-02-01 02:36:07,017 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52713
+ 2022-02-01 02:36:09,019 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52714
+ 2022-02-01 02:36:11,020 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52715
+ 2022-02-01 02:36:13,021 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52716
+ 2022-02-01 02:36:18,767 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52717
+ 2022-02-01 02:36:18,769 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52718
+ 2022-02-01 02:36:21,026 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52719
+ 2022-02-01 02:36:25,028 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52720
+ 2022-02-01 02:36:31,033 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52721
+ 2022-02-01 02:36:34,013 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52722
+ 2022-02-01 02:36:34,013 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52723
+ 2022-02-01 02:36:35,036 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52724
+ 2022-02-01 02:36:35,726 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52725
+ 2022-02-01 02:36:39,490 DEBUG SenderThread:55777 [sender.py:send():234] send: history
52726
+ 2022-02-01 02:36:39,555 DEBUG SenderThread:55777 [sender.py:send():234] send: summary
52727
+ 2022-02-01 02:36:39,591 INFO SenderThread:55777 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
52728
+ 2022-02-01 02:36:40,039 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json
52729
+ 2022-02-01 02:36:41,040 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52730
+ 2022-02-01 02:36:46,043 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52731
+ 2022-02-01 02:36:49,301 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52732
+ 2022-02-01 02:36:49,302 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52733
+ 2022-02-01 02:36:50,046 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52734
+ 2022-02-01 02:36:56,050 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52735
+ 2022-02-01 02:37:00,052 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52736
+ 2022-02-01 02:37:04,055 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52737
+ 2022-02-01 02:37:04,584 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52738
+ 2022-02-01 02:37:04,585 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52739
+ 2022-02-01 02:37:05,990 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52740
+ 2022-02-01 02:37:08,058 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52741
+ 2022-02-01 02:37:12,061 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52742
+ 2022-02-01 02:37:16,063 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52743
+ 2022-02-01 02:37:19,818 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52744
+ 2022-02-01 02:37:19,819 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52745
+ 2022-02-01 02:37:20,066 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52746
+ 2022-02-01 02:37:22,068 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52747
+ 2022-02-01 02:37:26,070 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52748
+ 2022-02-01 02:37:30,072 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52749
+ 2022-02-01 02:37:35,015 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52750
+ 2022-02-01 02:37:35,016 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52751
+ 2022-02-01 02:37:35,075 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52752
+ 2022-02-01 02:37:36,342 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52753
+ 2022-02-01 02:37:39,078 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52754
+ 2022-02-01 02:37:43,081 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52755
+ 2022-02-01 02:37:45,083 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52756
+ 2022-02-01 02:37:49,086 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52757
+ 2022-02-01 02:37:50,261 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52758
+ 2022-02-01 02:37:50,261 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52759
+ 2022-02-01 02:37:51,088 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52760
+ 2022-02-01 02:37:55,091 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52761
+ 2022-02-01 02:37:59,094 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52762
+ 2022-02-01 02:38:01,097 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52763
+ 2022-02-01 02:38:05,100 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52764
+ 2022-02-01 02:38:05,513 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52765
+ 2022-02-01 02:38:05,514 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52766
+ 2022-02-01 02:38:06,725 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52767
+ 2022-02-01 02:38:07,102 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52768
+ 2022-02-01 02:38:11,105 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52769
+ 2022-02-01 02:38:13,105 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52770
+ 2022-02-01 02:38:15,107 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52771
+ 2022-02-01 02:38:19,109 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52772
+ 2022-02-01 02:38:20,890 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52773
+ 2022-02-01 02:38:20,890 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52774
+ 2022-02-01 02:38:21,111 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52775
+ 2022-02-01 02:38:25,112 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52776
+ 2022-02-01 02:38:27,114 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52777
+ 2022-02-01 02:38:29,115 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52778
+ 2022-02-01 02:38:33,118 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52779
+ 2022-02-01 02:38:35,120 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52780
+ 2022-02-01 02:38:36,220 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52781
+ 2022-02-01 02:38:36,221 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52782
+ 2022-02-01 02:38:36,971 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52783
+ 2022-02-01 02:38:37,123 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52784
+ 2022-02-01 02:38:39,124 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52785
+ 2022-02-01 02:38:41,125 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52786
+ 2022-02-01 02:38:43,127 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52787
+ 2022-02-01 02:38:48,130 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52788
+ 2022-02-01 02:38:50,131 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52789
+ 2022-02-01 02:38:51,519 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52790
+ 2022-02-01 02:38:51,520 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52791
+ 2022-02-01 02:38:52,132 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52792
+ 2022-02-01 02:38:54,133 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52793
+ 2022-02-01 02:38:56,135 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52794
+ 2022-02-01 02:38:58,136 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52795
+ 2022-02-01 02:39:00,137 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52796
+ 2022-02-01 02:39:06,141 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52797
+ 2022-02-01 02:39:06,822 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52798
+ 2022-02-01 02:39:06,823 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52799
+ 2022-02-01 02:39:07,291 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52800
+ 2022-02-01 02:39:12,145 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52801
+ 2022-02-01 02:39:18,149 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52802
+ 2022-02-01 02:39:22,371 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52803
+ 2022-02-01 02:39:22,372 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52804
+ 2022-02-01 02:39:24,153 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52805
+ 2022-02-01 02:39:28,156 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52806
+ 2022-02-01 02:39:33,159 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52807
+ 2022-02-01 02:39:37,644 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52808
+ 2022-02-01 02:39:37,814 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52809
+ 2022-02-01 02:39:37,815 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52810
+ 2022-02-01 02:39:39,163 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52811
+ 2022-02-01 02:39:43,167 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52812
+ 2022-02-01 02:39:47,170 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52813
+ 2022-02-01 02:39:51,173 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52814
+ 2022-02-01 02:39:53,130 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52815
+ 2022-02-01 02:39:53,130 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52816
+ 2022-02-01 02:39:55,175 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52817
+ 2022-02-01 02:39:59,178 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52818
+ 2022-02-01 02:40:03,182 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52819
+ 2022-02-01 02:40:07,185 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52820
+ 2022-02-01 02:40:07,938 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52821
+ 2022-02-01 02:40:08,318 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52822
+ 2022-02-01 02:40:08,318 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52823
+ 2022-02-01 02:40:11,188 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52824
+ 2022-02-01 02:40:15,191 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52825
+ 2022-02-01 02:40:19,195 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52826
+ 2022-02-01 02:40:23,485 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52827
+ 2022-02-01 02:40:23,485 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52828
+ 2022-02-01 02:40:24,198 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52829
+ 2022-02-01 02:40:26,200 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52830
+ 2022-02-01 02:40:30,202 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52831
+ 2022-02-01 02:40:34,205 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52832
+ 2022-02-01 02:40:36,206 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52833
+ 2022-02-01 02:40:38,249 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52834
+ 2022-02-01 02:40:38,743 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52835
+ 2022-02-01 02:40:38,744 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52836
+ 2022-02-01 02:40:40,208 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52837
+ 2022-02-01 02:40:44,211 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52838
+ 2022-02-01 02:40:46,211 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52839
+ 2022-02-01 02:40:50,214 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52840
+ 2022-02-01 02:40:52,215 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52841
+ 2022-02-01 02:40:53,992 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52842
+ 2022-02-01 02:40:53,992 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52843
+ 2022-02-01 02:40:56,217 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52844
+ 2022-02-01 02:40:58,218 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52845
+ 2022-02-01 02:41:02,220 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52846
+ 2022-02-01 02:41:04,221 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52847
+ 2022-02-01 02:41:08,224 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52848
+ 2022-02-01 02:41:08,509 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52849
+ 2022-02-01 02:41:09,347 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52850
+ 2022-02-01 02:41:09,348 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52851
+ 2022-02-01 02:41:10,224 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52852
+ 2022-02-01 02:41:12,226 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52853
+ 2022-02-01 02:41:16,228 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52854
+ 2022-02-01 02:41:18,229 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52855
+ 2022-02-01 02:41:20,230 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52856
+ 2022-02-01 02:41:22,231 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52857
+ 2022-02-01 02:41:24,233 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52858
+ 2022-02-01 02:41:24,611 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52859
+ 2022-02-01 02:41:24,611 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52860
+ 2022-02-01 02:41:29,236 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52861
+ 2022-02-01 02:41:31,238 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52862
+ 2022-02-01 02:41:33,239 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52863
+ 2022-02-01 02:41:35,240 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52864
+ 2022-02-01 02:41:37,241 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52865
+ 2022-02-01 02:41:38,853 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52866
+ 2022-02-01 02:41:39,243 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52867
+ 2022-02-01 02:41:39,899 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52868
+ 2022-02-01 02:41:39,899 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52869
+ 2022-02-01 02:41:41,244 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52870
+ 2022-02-01 02:41:43,246 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52871
+ 2022-02-01 02:41:45,247 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52872
+ 2022-02-01 02:41:47,248 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52873
+ 2022-02-01 02:41:55,159 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52874
+ 2022-02-01 02:41:55,159 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52875
+ 2022-02-01 02:41:55,253 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52876
+ 2022-02-01 02:42:01,257 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52877
+ 2022-02-01 02:42:05,260 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52878
+ 2022-02-01 02:42:09,151 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52879
+ 2022-02-01 02:42:10,511 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52880
+ 2022-02-01 02:42:10,512 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52881
+ 2022-02-01 02:42:11,264 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52882
+ 2022-02-01 02:42:14,212 DEBUG SenderThread:55777 [sender.py:send():234] send: history
52883
+ 2022-02-01 02:42:14,325 DEBUG SenderThread:55777 [sender.py:send():234] send: summary
52884
+ 2022-02-01 02:42:14,376 INFO SenderThread:55777 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
52885
+ 2022-02-01 02:42:15,281 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json
52886
+ 2022-02-01 02:42:15,281 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52887
+ 2022-02-01 02:42:21,285 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52888
+ 2022-02-01 02:42:25,896 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52889
+ 2022-02-01 02:42:25,898 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52890
+ 2022-02-01 02:42:26,288 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52891
+ 2022-02-01 02:42:30,291 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52892
+ 2022-02-01 02:42:34,294 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52893
+ 2022-02-01 02:42:38,298 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52894
+ 2022-02-01 02:42:39,472 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52895
+ 2022-02-01 02:42:41,168 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52896
+ 2022-02-01 02:42:41,169 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52897
+ 2022-02-01 02:42:42,300 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52898
+ 2022-02-01 02:42:48,305 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52899
+ 2022-02-01 02:42:52,308 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52900
+ 2022-02-01 02:42:54,310 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52901
+ 2022-02-01 02:42:56,449 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52902
+ 2022-02-01 02:42:56,450 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52903
+ 2022-02-01 02:42:58,313 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52904
+ 2022-02-01 02:43:02,316 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52905
+ 2022-02-01 02:43:06,319 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52906
+ 2022-02-01 02:43:09,808 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52907
+ 2022-02-01 02:43:10,322 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52908
+ 2022-02-01 02:43:11,645 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52909
+ 2022-02-01 02:43:11,645 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52910
+ 2022-02-01 02:43:12,324 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52911
+ 2022-02-01 02:43:16,328 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52912
+ 2022-02-01 02:43:20,330 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52913
+ 2022-02-01 02:43:22,332 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52914
+ 2022-02-01 02:43:26,915 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52915
+ 2022-02-01 02:43:26,915 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52916
+ 2022-02-01 02:43:27,336 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52917
+ 2022-02-01 02:43:31,338 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52918
+ 2022-02-01 02:43:33,340 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52919
+ 2022-02-01 02:43:37,343 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52920
+ 2022-02-01 02:43:39,345 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52921
+ 2022-02-01 02:43:40,057 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52922
+ 2022-02-01 02:43:42,079 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52923
+ 2022-02-01 02:43:42,079 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52924
+ 2022-02-01 02:43:43,348 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52925
+ 2022-02-01 02:43:45,350 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52926
+ 2022-02-01 02:43:47,352 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52927
+ 2022-02-01 02:43:51,355 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52928
+ 2022-02-01 02:43:53,357 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52929
+ 2022-02-01 02:43:55,359 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52930
+ 2022-02-01 02:43:57,271 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52931
+ 2022-02-01 02:43:57,271 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52932
+ 2022-02-01 02:43:59,362 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52933
+ 2022-02-01 02:44:01,364 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52934
+ 2022-02-01 02:44:03,366 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52935
+ 2022-02-01 02:44:07,369 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52936
+ 2022-02-01 02:44:09,371 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52937
+ 2022-02-01 02:44:10,426 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52938
+ 2022-02-01 02:44:11,373 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52939
+ 2022-02-01 02:44:12,518 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52940
+ 2022-02-01 02:44:12,519 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52941
+ 2022-02-01 02:44:13,375 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52942
+ 2022-02-01 02:44:15,377 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52943
+ 2022-02-01 02:44:17,379 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52944
+ 2022-02-01 02:44:19,380 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52945
+ 2022-02-01 02:44:21,382 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52946
+ 2022-02-01 02:44:23,384 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52947
+ 2022-02-01 02:44:25,386 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52948
+ 2022-02-01 02:44:27,388 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52949
+ 2022-02-01 02:44:27,743 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52950
+ 2022-02-01 02:44:27,743 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52951
+ 2022-02-01 02:44:29,389 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52952
+ 2022-02-01 02:44:32,392 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52953
+ 2022-02-01 02:44:34,393 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52954
+ 2022-02-01 02:44:40,398 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52955
+ 2022-02-01 02:44:40,674 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52956
+ 2022-02-01 02:44:42,912 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52957
+ 2022-02-01 02:44:42,913 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52958
+ 2022-02-01 02:44:46,402 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52959
+ 2022-02-01 02:44:50,405 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52960
+ 2022-02-01 02:44:54,408 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52961
+ 2022-02-01 02:44:58,083 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52962
+ 2022-02-01 02:44:58,083 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52963
+ 2022-02-01 02:44:58,411 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52964
+ 2022-02-01 02:45:00,413 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52965
+ 2022-02-01 02:45:04,417 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52966
+ 2022-02-01 02:45:06,419 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52967
+ 2022-02-01 02:45:10,422 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52968
+ 2022-02-01 02:45:10,975 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52969
+ 2022-02-01 02:45:12,424 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52970
+ 2022-02-01 02:45:13,245 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52971
+ 2022-02-01 02:45:13,246 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52972
+ 2022-02-01 02:45:16,427 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52973
+ 2022-02-01 02:45:18,428 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52974
+ 2022-02-01 02:45:20,430 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52975
+ 2022-02-01 02:45:22,432 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52976
+ 2022-02-01 02:45:24,434 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52977
+ 2022-02-01 02:45:25,092 DEBUG SenderThread:55777 [sender.py:send():234] send: metric
52978
+ 2022-02-01 02:45:25,098 DEBUG SenderThread:55777 [sender.py:send():234] send: metric
52979
+ 2022-02-01 02:45:25,103 DEBUG SenderThread:55777 [sender.py:send():234] send: metric
52980
+ 2022-02-01 02:45:25,109 DEBUG SenderThread:55777 [sender.py:send():234] send: metric
52981
+ 2022-02-01 02:45:25,114 DEBUG SenderThread:55777 [sender.py:send():234] send: metric
52982
+ 2022-02-01 02:45:25,120 DEBUG SenderThread:55777 [sender.py:send():234] send: history
52983
+ 2022-02-01 02:45:25,134 DEBUG SenderThread:55777 [sender.py:send():234] send: summary
52984
+ 2022-02-01 02:45:25,189 INFO SenderThread:55777 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
52985
+ 2022-02-01 02:45:25,436 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/wandb-summary.json
52986
+ 2022-02-01 02:45:26,437 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52987
+ 2022-02-01 02:45:28,424 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52988
+ 2022-02-01 02:45:28,425 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52989
+ 2022-02-01 02:45:28,438 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52990
+ 2022-02-01 02:45:30,440 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/output.log
52991
+ 2022-02-01 02:45:41,839 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52992
+ 2022-02-01 02:45:42,449 INFO Thread-8 :55777 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-fr/wandb/run-20220130_191954-1mtmnz5y/files/config.yaml
52993
+ 2022-02-01 02:45:43,599 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52994
+ 2022-02-01 02:45:43,600 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52995
+ 2022-02-01 02:45:58,765 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52996
+ 2022-02-01 02:45:58,766 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
52997
+ 2022-02-01 02:46:11,504 DEBUG SenderThread:55777 [sender.py:send():234] send: stats
52998
+ 2022-02-01 02:46:13,940 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
52999
+ 2022-02-01 02:46:13,940 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
53000
+ 2022-02-01 02:46:29,111 DEBUG HandlerThread:55777 [handler.py:handle_request():130] handle_request: stop_status
53001
+ 2022-02-01 02:46:29,111 DEBUG SenderThread:55777 [sender.py:send_request():248] send_request: stop_status
wandb/run-20220130_191954-1mtmnz5y/run-1mtmnz5y.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:978b1df4463657ec0e45a0535fe2a5640ab29540af31b2703e93e203fd47e40d
3
- size 207181820
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f5b593fdaefa910ae05bc5af97f6bc8d25ada9af2e6ec67735515b11ed2b47e
3
+ size 209609416