Hugging Face's logo

patrickvonplaten
/
xls-r-300m-sv-cv8

Automatic Speech Recognition
Transformers
PyTorch
TensorBoard
wav2vec2
mozilla-foundation/common_voice_8_0
Generated from Trainer
sv
robust-speech-event
hf-asr-leaderboard
Eval Results
Inference Endpoints
Model card Files Metrics Community
patrickvonplaten commited on
Commit
bbc2006
·
1 Parent(s): 8eed110

Training in progress, step 16000

Browse files
Files changed (6) hide show
  1. pytorch_model.bin +1 -1
  2. runs/Feb02_22-30-13_brutasse/events.out.tfevents.1643841025.brutasse.21084.0 +2 -2
  3. wandb/run-20220202_223026-1j0459xm/files/output.log +397 -0
  4. wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json +0 -0
  5. wandb/run-20220202_223026-1j0459xm/logs/debug-internal.log +560 -0
  6. wandb/run-20220202_223026-1j0459xm/run-1j0459xm.wandb +2 -2
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf45415694eb890e2aed91f4796d1d73154d0b75e13be26f4472313d808af393
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf7beb962d96ef417c2a47bf8f64939fd1ba29357b6bacff448412b71a3b7e3b
3
  size 1262075377
runs/Feb02_22-30-13_brutasse/events.out.tfevents.1643841025.brutasse.21084.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60da3e2e668126e6e436ed2f3d2521108b00c74920e1223522250f587b10f471
3
- size 38871
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:627655adf78a11e476327d9110e36aac2269fb8fa8286ea341ef1e31304df3e2
3
+ size 39974
wandb/run-20220202_223026-1j0459xm/files/output.log CHANGED
@@ -12467,3 +12467,400 @@ Deleting older checkpoint [checkpoint-3500] due to args.save_total_limit
12467
  27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12468
  27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12469
  {'eval_loss': 0.28144747018814087, 'eval_wer': 0.25608856088560883, 'eval_runtime': 192.799, 'eval_samples_per_second': 25.119, 'eval_steps_per_second': 3.143, 'epoch': 42.47}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12467
  27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12468
  27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12469
  {'eval_loss': 0.28144747018814087, 'eval_wer': 0.25608856088560883, 'eval_runtime': 192.799, 'eval_samples_per_second': 25.119, 'eval_steps_per_second': 3.143, 'epoch': 42.47}
12470
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12471
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12472
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12473
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12474
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12475
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12476
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12477
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12478
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12479
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12480
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12481
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12482
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12483
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12484
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12485
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12486
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12487
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12488
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12489
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12490
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12491
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12492
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12493
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12494
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12495
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12496
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12497
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12498
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12499
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12500
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12501
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12502
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12503
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12504
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12505
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12506
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12507
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12508
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12509
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12510
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12511
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12512
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12513
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12514
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12515
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12516
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12517
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12518
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12519
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12520
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12521
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12522
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12523
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12524
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12525
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12526
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12527
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12528
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12529
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12530
+ {'loss': 1.0468, 'learning_rate': 1.227230769230769e-05, 'epoch': 42.74}
12531
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12532
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12533
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12534
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12535
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12536
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12537
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12538
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12539
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12540
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12541
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12542
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12543
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12544
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12545
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12546
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12547
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12548
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12549
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12550
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12551
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12552
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12553
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12554
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12555
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12556
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12557
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12558
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12559
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12560
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12561
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12562
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12563
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12564
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12565
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12566
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12567
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12568
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12569
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12570
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12571
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12572
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12573
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12574
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12575
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12576
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12577
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12578
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12579
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12580
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12581
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12582
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12583
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12584
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12585
+ 27%|█████████████���█▏ | 164/606 [00:41<01:41, 4.34it/s]
12586
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12587
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12588
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12589
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12590
+ {'loss': 1.073, 'learning_rate': 1.1815384615384615e-05, 'epoch': 43.01}
12591
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12592
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12593
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12594
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12595
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12596
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12597
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12598
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12599
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12600
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12601
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12602
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12603
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12604
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12605
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12606
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12607
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12608
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12609
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12610
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12611
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12612
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12613
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12614
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12615
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12616
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12617
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12618
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12619
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12620
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12621
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12622
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12623
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12624
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12625
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12626
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12627
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12628
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12629
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12630
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12631
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12632
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12633
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12634
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12635
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12636
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12637
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12638
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12639
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12640
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12641
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12642
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12643
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12644
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12645
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12646
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12647
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12648
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12649
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12650
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12651
+ {'loss': 1.05, 'learning_rate': 1.1353846153846154e-05, 'epoch': 43.29}
12652
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12653
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12654
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12655
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12656
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12657
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12658
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12659
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12660
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12661
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12662
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12663
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12664
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12665
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12666
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12667
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12668
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12669
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12670
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12671
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12672
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12673
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12674
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12675
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12676
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12677
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12678
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12679
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12680
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12681
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12682
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12683
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12684
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12685
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12686
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12687
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12688
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12689
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12690
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12691
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12692
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12693
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12694
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12695
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12696
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12697
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12698
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12699
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12700
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12701
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12702
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12703
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12704
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12705
+ 27%|██████████���████▏ | 164/606 [00:41<01:41, 4.34it/s]
12706
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12707
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12708
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12709
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12710
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12711
+ {'loss': 1.0562, 'learning_rate': 1.089230769230769e-05, 'epoch': 43.56}
12712
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12713
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12714
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12715
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12716
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12717
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12718
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12719
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12720
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12721
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12722
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12723
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12724
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12725
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12726
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12727
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12728
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12729
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12730
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12731
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12732
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12733
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12734
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12735
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12736
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12737
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12738
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12739
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12740
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12741
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12742
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12743
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12744
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12745
+ 27%|███████████████��� | 164/606 [00:41<01:41, 4.34it/s]
12746
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12747
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12748
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12749
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12750
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12751
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12752
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12753
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12754
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12755
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12756
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12757
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12758
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12759
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12760
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12761
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12762
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12763
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12764
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12765
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12766
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12767
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12768
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12769
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12770
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12771
+ {'loss': 1.0587, 'learning_rate': 1.043076923076923e-05, 'epoch': 43.83}
12772
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12773
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12774
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12775
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12776
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12777
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12778
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12779
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12780
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12781
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12782
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12783
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12784
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12785
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12786
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12787
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12788
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12789
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12790
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12791
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12792
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12793
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12794
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12795
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12796
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12797
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12798
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12799
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12800
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12801
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12802
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12803
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12804
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12805
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12806
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12807
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12808
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12809
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12810
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12811
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12812
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12813
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12814
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12815
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12816
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12817
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12818
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12819
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12820
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12821
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12822
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12823
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12824
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12825
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12826
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12827
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12828
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12829
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12830
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12831
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12832
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12833
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12834
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12835
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12836
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12837
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12838
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12839
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12840
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12841
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12842
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12843
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12844
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12845
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12846
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12847
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12848
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12849
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12850
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12851
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12852
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12853
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12854
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12855
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12856
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12857
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12858
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12859
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12860
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12861
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12862
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12863
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12864
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12865
+ 27%|███████████████▏ | 164/606 [00:41<01:41, 4.34it/s]
12866
+ {'eval_loss': 0.27383875846862793, 'eval_wer': 0.25421515753619073, 'eval_runtime': 191.944, 'eval_samples_per_second': 25.231, 'eval_steps_per_second': 3.157, 'epoch': 43.83}
wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220202_223026-1j0459xm/logs/debug-internal.log CHANGED
@@ -18705,3 +18705,563 @@
18705
  2022-02-03 05:53:00,233 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18706
  2022-02-03 05:53:09,083 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18707
  2022-02-03 05:53:09,083 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18705
  2022-02-03 05:53:00,233 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18706
  2022-02-03 05:53:09,083 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18707
  2022-02-03 05:53:09,083 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18708
+ 2022-02-03 05:53:20,849 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18709
+ 2022-02-03 05:53:22,849 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18710
+ 2022-02-03 05:53:24,165 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18711
+ 2022-02-03 05:53:24,165 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18712
+ 2022-02-03 05:53:24,850 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18713
+ 2022-02-03 05:53:26,850 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18714
+ 2022-02-03 05:53:28,851 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18715
+ 2022-02-03 05:53:30,513 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18716
+ 2022-02-03 05:53:30,851 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18717
+ 2022-02-03 05:53:32,852 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18718
+ 2022-02-03 05:53:34,852 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18719
+ 2022-02-03 05:53:36,853 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18720
+ 2022-02-03 05:53:38,853 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18721
+ 2022-02-03 05:53:39,244 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18722
+ 2022-02-03 05:53:39,244 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18723
+ 2022-02-03 05:53:40,854 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18724
+ 2022-02-03 05:53:42,854 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18725
+ 2022-02-03 05:53:44,854 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18726
+ 2022-02-03 05:53:46,855 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18727
+ 2022-02-03 05:53:48,855 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18728
+ 2022-02-03 05:53:50,855 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18729
+ 2022-02-03 05:53:54,399 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18730
+ 2022-02-03 05:53:54,399 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18731
+ 2022-02-03 05:53:55,856 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18732
+ 2022-02-03 05:53:57,856 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18733
+ 2022-02-03 05:53:59,857 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18734
+ 2022-02-03 05:54:00,757 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18735
+ 2022-02-03 05:54:01,857 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18736
+ 2022-02-03 05:54:03,857 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18737
+ 2022-02-03 05:54:05,857 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18738
+ 2022-02-03 05:54:07,858 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18739
+ 2022-02-03 05:54:09,501 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18740
+ 2022-02-03 05:54:09,501 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18741
+ 2022-02-03 05:54:09,858 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18742
+ 2022-02-03 05:54:11,858 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18743
+ 2022-02-03 05:54:13,859 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18744
+ 2022-02-03 05:54:15,859 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18745
+ 2022-02-03 05:54:17,859 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18746
+ 2022-02-03 05:54:19,860 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18747
+ 2022-02-03 05:54:21,860 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18748
+ 2022-02-03 05:54:23,860 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18749
+ 2022-02-03 05:54:24,666 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18750
+ 2022-02-03 05:54:24,666 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18751
+ 2022-02-03 05:54:25,861 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18752
+ 2022-02-03 05:54:27,861 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18753
+ 2022-02-03 05:54:29,862 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18754
+ 2022-02-03 05:54:31,002 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18755
+ 2022-02-03 05:54:31,862 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18756
+ 2022-02-03 05:54:33,862 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18757
+ 2022-02-03 05:54:35,863 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18758
+ 2022-02-03 05:54:37,863 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18759
+ 2022-02-03 05:54:39,738 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18760
+ 2022-02-03 05:54:39,738 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18761
+ 2022-02-03 05:54:39,863 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18762
+ 2022-02-03 05:54:41,864 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18763
+ 2022-02-03 05:54:43,864 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18764
+ 2022-02-03 05:54:45,864 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18765
+ 2022-02-03 05:54:47,865 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18766
+ 2022-02-03 05:54:49,865 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18767
+ 2022-02-03 05:54:51,865 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18768
+ 2022-02-03 05:54:53,865 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18769
+ 2022-02-03 05:54:54,900 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18770
+ 2022-02-03 05:54:54,900 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18771
+ 2022-02-03 05:54:55,866 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18772
+ 2022-02-03 05:54:57,866 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18773
+ 2022-02-03 05:54:59,866 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18774
+ 2022-02-03 05:55:01,254 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18775
+ 2022-02-03 05:55:01,867 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18776
+ 2022-02-03 05:55:03,867 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18777
+ 2022-02-03 05:55:05,867 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18778
+ 2022-02-03 05:55:07,868 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18779
+ 2022-02-03 05:55:09,868 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18780
+ 2022-02-03 05:55:10,036 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18781
+ 2022-02-03 05:55:10,036 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18782
+ 2022-02-03 05:55:11,868 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18783
+ 2022-02-03 05:55:13,869 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18784
+ 2022-02-03 05:55:15,869 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18785
+ 2022-02-03 05:55:17,869 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18786
+ 2022-02-03 05:55:19,870 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18787
+ 2022-02-03 05:55:20,272 DEBUG SenderThread:21197 [sender.py:send():182] send: history
18788
+ 2022-02-03 05:55:20,325 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
18789
+ 2022-02-03 05:55:20,350 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18790
+ 2022-02-03 05:55:20,870 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
18791
+ 2022-02-03 05:55:21,870 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18792
+ 2022-02-03 05:55:23,870 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18793
+ 2022-02-03 05:55:25,127 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18794
+ 2022-02-03 05:55:25,127 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18795
+ 2022-02-03 05:55:25,871 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18796
+ 2022-02-03 05:55:27,871 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18797
+ 2022-02-03 05:55:29,871 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18798
+ 2022-02-03 05:55:31,504 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18799
+ 2022-02-03 05:55:31,872 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18800
+ 2022-02-03 05:55:33,872 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18801
+ 2022-02-03 05:55:35,872 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18802
+ 2022-02-03 05:55:37,872 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18803
+ 2022-02-03 05:55:39,873 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18804
+ 2022-02-03 05:55:40,198 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18805
+ 2022-02-03 05:55:40,198 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18806
+ 2022-02-03 05:55:41,873 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18807
+ 2022-02-03 05:55:43,873 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18808
+ 2022-02-03 05:55:45,874 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18809
+ 2022-02-03 05:55:47,874 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18810
+ 2022-02-03 05:55:49,874 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18811
+ 2022-02-03 05:55:51,875 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18812
+ 2022-02-03 05:55:53,875 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18813
+ 2022-02-03 05:55:55,315 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18814
+ 2022-02-03 05:55:55,315 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18815
+ 2022-02-03 05:55:55,875 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18816
+ 2022-02-03 05:55:57,876 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18817
+ 2022-02-03 05:55:59,876 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18818
+ 2022-02-03 05:56:01,737 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18819
+ 2022-02-03 05:56:01,876 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18820
+ 2022-02-03 05:56:03,876 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18821
+ 2022-02-03 05:56:05,877 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18822
+ 2022-02-03 05:56:07,877 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18823
+ 2022-02-03 05:56:09,877 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18824
+ 2022-02-03 05:56:10,438 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18825
+ 2022-02-03 05:56:10,438 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18826
+ 2022-02-03 05:56:12,878 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18827
+ 2022-02-03 05:56:14,878 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18828
+ 2022-02-03 05:56:16,878 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18829
+ 2022-02-03 05:56:18,879 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18830
+ 2022-02-03 05:56:20,879 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18831
+ 2022-02-03 05:56:22,879 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18832
+ 2022-02-03 05:56:24,880 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18833
+ 2022-02-03 05:56:25,586 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18834
+ 2022-02-03 05:56:25,586 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18835
+ 2022-02-03 05:56:26,880 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18836
+ 2022-02-03 05:56:28,881 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18837
+ 2022-02-03 05:56:30,881 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18838
+ 2022-02-03 05:56:31,971 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18839
+ 2022-02-03 05:56:32,881 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18840
+ 2022-02-03 05:56:34,881 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18841
+ 2022-02-03 05:56:36,882 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18842
+ 2022-02-03 05:56:38,882 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18843
+ 2022-02-03 05:56:40,653 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18844
+ 2022-02-03 05:56:40,653 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18845
+ 2022-02-03 05:56:40,882 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18846
+ 2022-02-03 05:56:42,883 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18847
+ 2022-02-03 05:56:44,883 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18848
+ 2022-02-03 05:56:46,883 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18849
+ 2022-02-03 05:56:48,884 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18850
+ 2022-02-03 05:56:50,884 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18851
+ 2022-02-03 05:56:52,884 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18852
+ 2022-02-03 05:56:54,885 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18853
+ 2022-02-03 05:56:55,815 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18854
+ 2022-02-03 05:56:55,815 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18855
+ 2022-02-03 05:56:56,885 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18856
+ 2022-02-03 05:56:58,885 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18857
+ 2022-02-03 05:57:00,886 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18858
+ 2022-02-03 05:57:02,224 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18859
+ 2022-02-03 05:57:02,886 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18860
+ 2022-02-03 05:57:04,886 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18861
+ 2022-02-03 05:57:06,887 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18862
+ 2022-02-03 05:57:08,887 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18863
+ 2022-02-03 05:57:10,888 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18864
+ 2022-02-03 05:57:10,972 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18865
+ 2022-02-03 05:57:10,972 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18866
+ 2022-02-03 05:57:12,888 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18867
+ 2022-02-03 05:57:14,888 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18868
+ 2022-02-03 05:57:16,888 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18869
+ 2022-02-03 05:57:18,532 DEBUG SenderThread:21197 [sender.py:send():182] send: history
18870
+ 2022-02-03 05:57:18,576 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
18871
+ 2022-02-03 05:57:18,599 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18872
+ 2022-02-03 05:57:18,889 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
18873
+ 2022-02-03 05:57:18,889 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18874
+ 2022-02-03 05:57:20,889 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18875
+ 2022-02-03 05:57:22,889 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18876
+ 2022-02-03 05:57:24,890 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18877
+ 2022-02-03 05:57:26,076 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18878
+ 2022-02-03 05:57:26,077 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18879
+ 2022-02-03 05:57:26,890 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18880
+ 2022-02-03 05:57:28,890 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18881
+ 2022-02-03 05:57:30,891 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18882
+ 2022-02-03 05:57:32,477 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18883
+ 2022-02-03 05:57:32,891 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18884
+ 2022-02-03 05:57:34,891 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18885
+ 2022-02-03 05:57:36,892 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18886
+ 2022-02-03 05:57:38,892 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18887
+ 2022-02-03 05:57:40,892 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18888
+ 2022-02-03 05:57:41,147 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18889
+ 2022-02-03 05:57:41,147 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18890
+ 2022-02-03 05:57:42,893 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18891
+ 2022-02-03 05:57:44,893 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18892
+ 2022-02-03 05:57:46,893 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18893
+ 2022-02-03 05:57:48,893 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18894
+ 2022-02-03 05:57:50,894 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18895
+ 2022-02-03 05:57:52,894 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18896
+ 2022-02-03 05:57:54,894 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18897
+ 2022-02-03 05:57:56,228 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18898
+ 2022-02-03 05:57:56,228 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18899
+ 2022-02-03 05:57:56,895 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18900
+ 2022-02-03 05:57:58,895 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18901
+ 2022-02-03 05:58:00,895 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18902
+ 2022-02-03 05:58:02,726 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18903
+ 2022-02-03 05:58:02,896 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18904
+ 2022-02-03 05:58:04,896 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18905
+ 2022-02-03 05:58:06,896 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18906
+ 2022-02-03 05:58:08,897 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18907
+ 2022-02-03 05:58:10,897 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18908
+ 2022-02-03 05:58:11,337 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18909
+ 2022-02-03 05:58:11,337 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18910
+ 2022-02-03 05:58:12,897 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18911
+ 2022-02-03 05:58:14,898 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18912
+ 2022-02-03 05:58:16,898 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18913
+ 2022-02-03 05:58:18,898 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18914
+ 2022-02-03 05:58:20,899 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18915
+ 2022-02-03 05:58:22,899 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18916
+ 2022-02-03 05:58:24,899 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18917
+ 2022-02-03 05:58:26,410 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18918
+ 2022-02-03 05:58:26,411 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18919
+ 2022-02-03 05:58:26,900 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18920
+ 2022-02-03 05:58:28,900 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18921
+ 2022-02-03 05:58:30,900 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18922
+ 2022-02-03 05:58:32,901 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18923
+ 2022-02-03 05:58:32,986 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18924
+ 2022-02-03 05:58:34,901 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18925
+ 2022-02-03 05:58:36,901 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18926
+ 2022-02-03 05:58:38,902 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18927
+ 2022-02-03 05:58:41,484 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18928
+ 2022-02-03 05:58:41,484 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18929
+ 2022-02-03 05:58:41,902 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18930
+ 2022-02-03 05:58:43,902 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18931
+ 2022-02-03 05:58:45,903 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18932
+ 2022-02-03 05:58:47,903 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18933
+ 2022-02-03 05:58:49,903 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18934
+ 2022-02-03 05:58:51,904 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18935
+ 2022-02-03 05:58:53,904 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18936
+ 2022-02-03 05:58:55,904 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18937
+ 2022-02-03 05:58:56,556 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18938
+ 2022-02-03 05:58:56,556 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18939
+ 2022-02-03 05:58:57,904 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18940
+ 2022-02-03 05:58:59,905 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18941
+ 2022-02-03 05:59:01,905 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18942
+ 2022-02-03 05:59:03,235 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18943
+ 2022-02-03 05:59:03,905 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18944
+ 2022-02-03 05:59:05,906 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18945
+ 2022-02-03 05:59:07,906 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18946
+ 2022-02-03 05:59:09,906 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18947
+ 2022-02-03 05:59:11,668 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18948
+ 2022-02-03 05:59:11,668 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18949
+ 2022-02-03 05:59:11,907 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18950
+ 2022-02-03 05:59:13,907 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18951
+ 2022-02-03 05:59:15,907 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18952
+ 2022-02-03 05:59:17,908 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18953
+ 2022-02-03 05:59:18,603 DEBUG SenderThread:21197 [sender.py:send():182] send: history
18954
+ 2022-02-03 05:59:18,648 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
18955
+ 2022-02-03 05:59:18,671 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18956
+ 2022-02-03 05:59:18,908 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
18957
+ 2022-02-03 05:59:19,908 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18958
+ 2022-02-03 05:59:20,908 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18959
+ 2022-02-03 05:59:21,908 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18960
+ 2022-02-03 05:59:23,909 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18961
+ 2022-02-03 05:59:25,909 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18962
+ 2022-02-03 05:59:26,781 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18963
+ 2022-02-03 05:59:26,782 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18964
+ 2022-02-03 05:59:27,909 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18965
+ 2022-02-03 05:59:29,910 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18966
+ 2022-02-03 05:59:31,910 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18967
+ 2022-02-03 05:59:33,479 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18968
+ 2022-02-03 05:59:33,910 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18969
+ 2022-02-03 05:59:35,911 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18970
+ 2022-02-03 05:59:37,911 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18971
+ 2022-02-03 05:59:39,911 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18972
+ 2022-02-03 05:59:41,894 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18973
+ 2022-02-03 05:59:41,895 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18974
+ 2022-02-03 05:59:41,912 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18975
+ 2022-02-03 05:59:43,912 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18976
+ 2022-02-03 05:59:45,912 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18977
+ 2022-02-03 05:59:47,913 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18978
+ 2022-02-03 05:59:49,913 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18979
+ 2022-02-03 05:59:51,913 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18980
+ 2022-02-03 05:59:53,913 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18981
+ 2022-02-03 05:59:55,914 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18982
+ 2022-02-03 05:59:56,978 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18983
+ 2022-02-03 05:59:56,978 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18984
+ 2022-02-03 05:59:57,914 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18985
+ 2022-02-03 05:59:59,914 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18986
+ 2022-02-03 06:00:01,915 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18987
+ 2022-02-03 06:00:03,728 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
18988
+ 2022-02-03 06:00:03,915 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18989
+ 2022-02-03 06:00:05,915 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18990
+ 2022-02-03 06:00:07,916 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18991
+ 2022-02-03 06:00:09,916 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18992
+ 2022-02-03 06:00:12,080 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
18993
+ 2022-02-03 06:00:12,080 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
18994
+ 2022-02-03 06:00:13,917 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18995
+ 2022-02-03 06:00:15,917 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18996
+ 2022-02-03 06:00:17,917 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18997
+ 2022-02-03 06:00:19,918 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18998
+ 2022-02-03 06:00:21,918 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
18999
+ 2022-02-03 06:00:23,918 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19000
+ 2022-02-03 06:00:25,918 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19001
+ 2022-02-03 06:00:27,201 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19002
+ 2022-02-03 06:00:27,201 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19003
+ 2022-02-03 06:00:27,919 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19004
+ 2022-02-03 06:00:29,919 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19005
+ 2022-02-03 06:00:31,919 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19006
+ 2022-02-03 06:00:33,920 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19007
+ 2022-02-03 06:00:33,982 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19008
+ 2022-02-03 06:00:35,920 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19009
+ 2022-02-03 06:00:37,920 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19010
+ 2022-02-03 06:00:39,921 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19011
+ 2022-02-03 06:00:41,921 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19012
+ 2022-02-03 06:00:42,277 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19013
+ 2022-02-03 06:00:42,277 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19014
+ 2022-02-03 06:00:43,921 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19015
+ 2022-02-03 06:00:45,922 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19016
+ 2022-02-03 06:00:47,922 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19017
+ 2022-02-03 06:00:49,922 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19018
+ 2022-02-03 06:00:51,923 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19019
+ 2022-02-03 06:00:53,923 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19020
+ 2022-02-03 06:00:55,923 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19021
+ 2022-02-03 06:00:57,404 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19022
+ 2022-02-03 06:00:57,404 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19023
+ 2022-02-03 06:00:57,924 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19024
+ 2022-02-03 06:00:59,924 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19025
+ 2022-02-03 06:01:01,924 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19026
+ 2022-02-03 06:01:03,924 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19027
+ 2022-02-03 06:01:04,230 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19028
+ 2022-02-03 06:01:05,925 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19029
+ 2022-02-03 06:01:07,925 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19030
+ 2022-02-03 06:01:09,925 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19031
+ 2022-02-03 06:01:11,926 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19032
+ 2022-02-03 06:01:12,487 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19033
+ 2022-02-03 06:01:12,487 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19034
+ 2022-02-03 06:01:13,926 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19035
+ 2022-02-03 06:01:15,926 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19036
+ 2022-02-03 06:01:17,927 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19037
+ 2022-02-03 06:01:18,670 DEBUG SenderThread:21197 [sender.py:send():182] send: history
19038
+ 2022-02-03 06:01:18,712 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
19039
+ 2022-02-03 06:01:18,735 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19040
+ 2022-02-03 06:01:18,927 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
19041
+ 2022-02-03 06:01:20,927 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19042
+ 2022-02-03 06:01:22,928 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19043
+ 2022-02-03 06:01:24,928 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19044
+ 2022-02-03 06:01:26,928 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19045
+ 2022-02-03 06:01:27,615 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19046
+ 2022-02-03 06:01:27,615 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19047
+ 2022-02-03 06:01:28,929 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19048
+ 2022-02-03 06:01:30,929 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19049
+ 2022-02-03 06:01:32,929 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19050
+ 2022-02-03 06:01:34,457 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19051
+ 2022-02-03 06:01:34,930 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19052
+ 2022-02-03 06:01:36,930 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19053
+ 2022-02-03 06:01:38,930 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19054
+ 2022-02-03 06:01:40,930 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19055
+ 2022-02-03 06:01:42,690 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19056
+ 2022-02-03 06:01:42,690 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19057
+ 2022-02-03 06:01:42,931 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19058
+ 2022-02-03 06:01:44,931 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19059
+ 2022-02-03 06:01:46,931 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19060
+ 2022-02-03 06:01:48,932 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19061
+ 2022-02-03 06:01:50,932 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19062
+ 2022-02-03 06:01:52,932 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19063
+ 2022-02-03 06:01:54,933 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19064
+ 2022-02-03 06:01:56,933 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19065
+ 2022-02-03 06:01:57,792 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19066
+ 2022-02-03 06:01:57,792 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19067
+ 2022-02-03 06:01:58,933 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19068
+ 2022-02-03 06:02:00,934 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19069
+ 2022-02-03 06:02:02,934 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19070
+ 2022-02-03 06:02:04,691 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19071
+ 2022-02-03 06:02:04,934 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19072
+ 2022-02-03 06:02:06,935 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19073
+ 2022-02-03 06:02:08,935 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19074
+ 2022-02-03 06:02:10,935 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19075
+ 2022-02-03 06:02:12,938 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19076
+ 2022-02-03 06:02:12,938 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19077
+ 2022-02-03 06:02:14,936 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19078
+ 2022-02-03 06:02:16,936 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19079
+ 2022-02-03 06:02:18,937 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19080
+ 2022-02-03 06:02:20,937 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19081
+ 2022-02-03 06:02:22,937 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19082
+ 2022-02-03 06:02:24,938 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19083
+ 2022-02-03 06:02:26,938 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19084
+ 2022-02-03 06:02:28,115 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19085
+ 2022-02-03 06:02:28,115 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19086
+ 2022-02-03 06:02:28,938 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19087
+ 2022-02-03 06:02:30,938 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19088
+ 2022-02-03 06:02:32,939 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19089
+ 2022-02-03 06:02:34,935 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19090
+ 2022-02-03 06:02:34,939 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19091
+ 2022-02-03 06:02:36,940 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19092
+ 2022-02-03 06:02:38,940 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19093
+ 2022-02-03 06:02:40,940 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19094
+ 2022-02-03 06:02:42,941 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19095
+ 2022-02-03 06:02:43,189 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19096
+ 2022-02-03 06:02:43,189 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19097
+ 2022-02-03 06:02:44,941 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19098
+ 2022-02-03 06:02:46,941 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19099
+ 2022-02-03 06:02:48,942 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19100
+ 2022-02-03 06:02:50,942 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19101
+ 2022-02-03 06:02:52,942 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19102
+ 2022-02-03 06:02:54,943 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19103
+ 2022-02-03 06:02:56,943 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19104
+ 2022-02-03 06:02:58,290 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19105
+ 2022-02-03 06:02:58,291 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19106
+ 2022-02-03 06:02:58,943 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19107
+ 2022-02-03 06:03:00,943 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19108
+ 2022-02-03 06:03:02,944 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19109
+ 2022-02-03 06:03:04,944 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19110
+ 2022-02-03 06:03:05,168 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19111
+ 2022-02-03 06:03:06,944 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19112
+ 2022-02-03 06:03:08,945 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19113
+ 2022-02-03 06:03:10,945 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19114
+ 2022-02-03 06:03:12,945 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19115
+ 2022-02-03 06:03:13,363 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19116
+ 2022-02-03 06:03:13,363 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19117
+ 2022-02-03 06:03:14,946 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19118
+ 2022-02-03 06:03:16,946 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19119
+ 2022-02-03 06:03:18,854 DEBUG SenderThread:21197 [sender.py:send():182] send: history
19120
+ 2022-02-03 06:03:18,903 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
19121
+ 2022-02-03 06:03:18,925 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19122
+ 2022-02-03 06:03:18,947 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
19123
+ 2022-02-03 06:03:18,947 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19124
+ 2022-02-03 06:03:20,947 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19125
+ 2022-02-03 06:03:21,947 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19126
+ 2022-02-03 06:03:22,947 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19127
+ 2022-02-03 06:03:24,948 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19128
+ 2022-02-03 06:03:26,948 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19129
+ 2022-02-03 06:03:28,435 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19130
+ 2022-02-03 06:03:28,436 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19131
+ 2022-02-03 06:03:28,949 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19132
+ 2022-02-03 06:03:31,949 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19133
+ 2022-02-03 06:03:33,950 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19134
+ 2022-02-03 06:03:35,410 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19135
+ 2022-02-03 06:03:35,951 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19136
+ 2022-02-03 06:03:37,951 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19137
+ 2022-02-03 06:03:39,952 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19138
+ 2022-02-03 06:03:41,952 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19139
+ 2022-02-03 06:03:43,538 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19140
+ 2022-02-03 06:03:43,538 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19141
+ 2022-02-03 06:03:43,952 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19142
+ 2022-02-03 06:03:45,953 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19143
+ 2022-02-03 06:03:47,954 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19144
+ 2022-02-03 06:03:49,954 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19145
+ 2022-02-03 06:03:51,955 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19146
+ 2022-02-03 06:03:53,955 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19147
+ 2022-02-03 06:03:55,955 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19148
+ 2022-02-03 06:03:57,956 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19149
+ 2022-02-03 06:03:58,652 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19150
+ 2022-02-03 06:03:58,652 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19151
+ 2022-02-03 06:03:59,956 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19152
+ 2022-02-03 06:04:01,957 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19153
+ 2022-02-03 06:04:03,958 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19154
+ 2022-02-03 06:04:05,650 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19155
+ 2022-02-03 06:04:05,958 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19156
+ 2022-02-03 06:04:07,958 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19157
+ 2022-02-03 06:04:09,959 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19158
+ 2022-02-03 06:04:11,959 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19159
+ 2022-02-03 06:04:13,761 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19160
+ 2022-02-03 06:04:13,761 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19161
+ 2022-02-03 06:04:13,959 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19162
+ 2022-02-03 06:04:15,960 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19163
+ 2022-02-03 06:04:17,960 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19164
+ 2022-02-03 06:04:19,960 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19165
+ 2022-02-03 06:04:21,961 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19166
+ 2022-02-03 06:04:23,961 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19167
+ 2022-02-03 06:04:25,961 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19168
+ 2022-02-03 06:04:27,961 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19169
+ 2022-02-03 06:04:28,875 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19170
+ 2022-02-03 06:04:28,875 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19171
+ 2022-02-03 06:04:29,962 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19172
+ 2022-02-03 06:04:31,962 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19173
+ 2022-02-03 06:04:33,963 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19174
+ 2022-02-03 06:04:35,901 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19175
+ 2022-02-03 06:04:36,963 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19176
+ 2022-02-03 06:04:38,964 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19177
+ 2022-02-03 06:04:40,964 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19178
+ 2022-02-03 06:04:42,964 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19179
+ 2022-02-03 06:04:44,040 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19180
+ 2022-02-03 06:04:44,040 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19181
+ 2022-02-03 06:04:44,964 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19182
+ 2022-02-03 06:04:46,965 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19183
+ 2022-02-03 06:04:48,965 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19184
+ 2022-02-03 06:04:50,966 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19185
+ 2022-02-03 06:04:52,966 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19186
+ 2022-02-03 06:04:54,966 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19187
+ 2022-02-03 06:04:56,967 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19188
+ 2022-02-03 06:04:58,967 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19189
+ 2022-02-03 06:04:59,120 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19190
+ 2022-02-03 06:04:59,120 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19191
+ 2022-02-03 06:05:00,967 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19192
+ 2022-02-03 06:05:02,968 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19193
+ 2022-02-03 06:05:04,968 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19194
+ 2022-02-03 06:05:06,155 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19195
+ 2022-02-03 06:05:06,968 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19196
+ 2022-02-03 06:05:08,969 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19197
+ 2022-02-03 06:05:10,969 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19198
+ 2022-02-03 06:05:12,969 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19199
+ 2022-02-03 06:05:14,274 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19200
+ 2022-02-03 06:05:14,274 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19201
+ 2022-02-03 06:05:14,970 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19202
+ 2022-02-03 06:05:16,970 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19203
+ 2022-02-03 06:05:18,970 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19204
+ 2022-02-03 06:05:20,970 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19205
+ 2022-02-03 06:05:22,971 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19206
+ 2022-02-03 06:05:24,971 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19207
+ 2022-02-03 06:05:26,971 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19208
+ 2022-02-03 06:05:28,972 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19209
+ 2022-02-03 06:05:29,417 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19210
+ 2022-02-03 06:05:29,418 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19211
+ 2022-02-03 06:05:31,972 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19212
+ 2022-02-03 06:05:33,973 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19213
+ 2022-02-03 06:05:35,973 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19214
+ 2022-02-03 06:05:36,401 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19215
+ 2022-02-03 06:05:37,973 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19216
+ 2022-02-03 06:05:39,974 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19217
+ 2022-02-03 06:05:41,974 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19218
+ 2022-02-03 06:05:43,974 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19219
+ 2022-02-03 06:05:44,491 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19220
+ 2022-02-03 06:05:44,491 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19221
+ 2022-02-03 06:05:45,975 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19222
+ 2022-02-03 06:05:47,975 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19223
+ 2022-02-03 06:05:49,975 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19224
+ 2022-02-03 06:05:51,975 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19225
+ 2022-02-03 06:05:53,976 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19226
+ 2022-02-03 06:05:55,976 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19227
+ 2022-02-03 06:05:57,976 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19228
+ 2022-02-03 06:05:59,559 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19229
+ 2022-02-03 06:05:59,559 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19230
+ 2022-02-03 06:05:59,977 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19231
+ 2022-02-03 06:06:01,977 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19232
+ 2022-02-03 06:06:03,977 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19233
+ 2022-02-03 06:06:05,978 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19234
+ 2022-02-03 06:06:06,641 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19235
+ 2022-02-03 06:06:07,978 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19236
+ 2022-02-03 06:06:09,978 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19237
+ 2022-02-03 06:06:11,979 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19238
+ 2022-02-03 06:06:13,979 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19239
+ 2022-02-03 06:06:14,629 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19240
+ 2022-02-03 06:06:14,630 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19241
+ 2022-02-03 06:06:15,979 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19242
+ 2022-02-03 06:06:17,980 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19243
+ 2022-02-03 06:06:19,980 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19244
+ 2022-02-03 06:06:22,981 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19245
+ 2022-02-03 06:06:24,981 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19246
+ 2022-02-03 06:06:26,981 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19247
+ 2022-02-03 06:06:28,982 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19248
+ 2022-02-03 06:06:29,777 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19249
+ 2022-02-03 06:06:29,777 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19250
+ 2022-02-03 06:06:30,788 DEBUG SenderThread:21197 [sender.py:send():182] send: history
19251
+ 2022-02-03 06:06:30,799 DEBUG SenderThread:21197 [sender.py:send():182] send: summary
19252
+ 2022-02-03 06:06:30,826 INFO SenderThread:21197 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19253
+ 2022-02-03 06:06:30,982 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/wandb-summary.json
19254
+ 2022-02-03 06:06:30,983 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19255
+ 2022-02-03 06:06:32,983 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19256
+ 2022-02-03 06:06:36,908 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19257
+ 2022-02-03 06:06:44,879 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19258
+ 2022-02-03 06:06:44,880 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19259
+ 2022-02-03 06:06:59,954 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19260
+ 2022-02-03 06:06:59,954 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19261
+ 2022-02-03 06:07:07,249 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
19262
+ 2022-02-03 06:07:12,998 INFO Thread-8 :21197 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220202_223026-1j0459xm/files/output.log
19263
+ 2022-02-03 06:07:15,025 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19264
+ 2022-02-03 06:07:15,026 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19265
+ 2022-02-03 06:07:30,102 DEBUG HandlerThread:21197 [handler.py:handle_request():126] handle_request: stop_status
19266
+ 2022-02-03 06:07:30,102 DEBUG SenderThread:21197 [sender.py:send_request():196] send_request: stop_status
19267
+ 2022-02-03 06:07:37,534 DEBUG SenderThread:21197 [sender.py:send():182] send: stats
wandb/run-20220202_223026-1j0459xm/run-1j0459xm.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12fea98de13eee9dd71f875b1b95b89b00bedd6194bf8b51e5d6a17aced6c9e5
3
- size 104035368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca1935509053ed1c1563558206988f250c446599b8cb7c5fe5710c482ce81418
3
+ size 107393028