NikitaKukuzey commited on
Commit
a5fa96c
·
1 Parent(s): 66f7795

Training in progress, step 1500

Browse files
runs/Nov23_11-43-08_c7ac5a6dfa40/events.out.tfevents.1700739816.c7ac5a6dfa40.47.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61c2fc5c79d589db30b1020a14a67d724cd9484bdabf4c2bcadf959d4d6587cd
3
- size 4911
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:809a5d6f7ff8ec02b85ae7df8910950b2b9c260b748c920531a8cf9be1d18185
3
+ size 5068
wandb/debug-internal.log CHANGED
@@ -401,3 +401,171 @@
401
  2023-11-23 11:57:09,134 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
402
  2023-11-23 11:57:10,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
403
  2023-11-23 11:57:14,135 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
401
  2023-11-23 11:57:09,134 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
402
  2023-11-23 11:57:10,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
403
  2023-11-23 11:57:14,135 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
404
+ 2023-11-23 11:57:15,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
405
+ 2023-11-23 11:57:19,136 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
406
+ 2023-11-23 11:57:20,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
407
+ 2023-11-23 11:57:24,137 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
408
+ 2023-11-23 11:57:25,838 DEBUG SenderThread:160 [sender.py:send():380] send: stats
409
+ 2023-11-23 11:57:26,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
410
+ 2023-11-23 11:57:29,148 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
411
+ 2023-11-23 11:57:31,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
412
+ 2023-11-23 11:57:34,157 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
413
+ 2023-11-23 11:57:36,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
414
+ 2023-11-23 11:57:39,163 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
415
+ 2023-11-23 11:57:41,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
416
+ 2023-11-23 11:57:44,164 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
417
+ 2023-11-23 11:57:46,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
418
+ 2023-11-23 11:57:49,166 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
419
+ 2023-11-23 11:57:51,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
420
+ 2023-11-23 11:57:54,167 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
421
+ 2023-11-23 11:57:55,839 DEBUG SenderThread:160 [sender.py:send():380] send: stats
422
+ 2023-11-23 11:57:57,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
423
+ 2023-11-23 11:57:59,172 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
424
+ 2023-11-23 11:58:02,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
425
+ 2023-11-23 11:58:04,176 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
426
+ 2023-11-23 11:58:07,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
427
+ 2023-11-23 11:58:09,177 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
428
+ 2023-11-23 11:58:12,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
429
+ 2023-11-23 11:58:14,192 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
430
+ 2023-11-23 11:58:17,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
431
+ 2023-11-23 11:58:19,193 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
432
+ 2023-11-23 11:58:22,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
433
+ 2023-11-23 11:58:24,201 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
434
+ 2023-11-23 11:58:25,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats
435
+ 2023-11-23 11:58:28,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
436
+ 2023-11-23 11:58:29,202 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
437
+ 2023-11-23 11:58:33,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
438
+ 2023-11-23 11:58:34,203 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
439
+ 2023-11-23 11:58:38,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
440
+ 2023-11-23 11:58:39,204 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
441
+ 2023-11-23 11:58:43,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
442
+ 2023-11-23 11:58:44,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
443
+ 2023-11-23 11:58:48,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
444
+ 2023-11-23 11:58:49,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
445
+ 2023-11-23 11:58:53,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
446
+ 2023-11-23 11:58:54,215 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
447
+ 2023-11-23 11:58:55,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats
448
+ 2023-11-23 11:58:59,216 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
449
+ 2023-11-23 11:58:59,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
450
+ 2023-11-23 11:59:04,217 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
451
+ 2023-11-23 11:59:04,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
452
+ 2023-11-23 11:59:09,223 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
453
+ 2023-11-23 11:59:09,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
454
+ 2023-11-23 11:59:14,224 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
455
+ 2023-11-23 11:59:14,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
456
+ 2023-11-23 11:59:19,225 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
457
+ 2023-11-23 11:59:19,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
458
+ 2023-11-23 11:59:24,226 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
459
+ 2023-11-23 11:59:24,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
460
+ 2023-11-23 11:59:25,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats
461
+ 2023-11-23 11:59:29,227 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
462
+ 2023-11-23 11:59:30,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
463
+ 2023-11-23 11:59:34,231 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
464
+ 2023-11-23 11:59:35,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
465
+ 2023-11-23 11:59:39,232 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
466
+ 2023-11-23 11:59:40,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
467
+ 2023-11-23 11:59:44,241 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
468
+ 2023-11-23 11:59:45,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
469
+ 2023-11-23 11:59:49,246 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
470
+ 2023-11-23 11:59:50,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
471
+ 2023-11-23 11:59:54,247 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
472
+ 2023-11-23 11:59:55,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats
473
+ 2023-11-23 11:59:56,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
474
+ 2023-11-23 11:59:59,251 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
475
+ 2023-11-23 12:00:01,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
476
+ 2023-11-23 12:00:04,258 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
477
+ 2023-11-23 12:00:06,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
478
+ 2023-11-23 12:00:09,259 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
479
+ 2023-11-23 12:00:11,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
480
+ 2023-11-23 12:00:14,263 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
481
+ 2023-11-23 12:00:16,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
482
+ 2023-11-23 12:00:19,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
483
+ 2023-11-23 12:00:21,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
484
+ 2023-11-23 12:00:24,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
485
+ 2023-11-23 12:00:25,843 DEBUG SenderThread:160 [sender.py:send():380] send: stats
486
+ 2023-11-23 12:00:27,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
487
+ 2023-11-23 12:00:29,272 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
488
+ 2023-11-23 12:00:32,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
489
+ 2023-11-23 12:00:34,295 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
490
+ 2023-11-23 12:00:37,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
491
+ 2023-11-23 12:00:39,296 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
492
+ 2023-11-23 12:00:42,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
493
+ 2023-11-23 12:00:44,297 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
494
+ 2023-11-23 12:00:47,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
495
+ 2023-11-23 12:00:49,298 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
496
+ 2023-11-23 12:00:52,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
497
+ 2023-11-23 12:00:54,299 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
498
+ 2023-11-23 12:00:55,844 DEBUG SenderThread:160 [sender.py:send():380] send: stats
499
+ 2023-11-23 12:00:58,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
500
+ 2023-11-23 12:00:59,300 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
501
+ 2023-11-23 12:01:03,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
502
+ 2023-11-23 12:01:04,302 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
503
+ 2023-11-23 12:01:08,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
504
+ 2023-11-23 12:01:09,303 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
505
+ 2023-11-23 12:01:13,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
506
+ 2023-11-23 12:01:14,304 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
507
+ 2023-11-23 12:01:18,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
508
+ 2023-11-23 12:01:19,305 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
509
+ 2023-11-23 12:01:23,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
510
+ 2023-11-23 12:01:24,306 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
511
+ 2023-11-23 12:01:25,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats
512
+ 2023-11-23 12:01:29,307 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
513
+ 2023-11-23 12:01:29,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
514
+ 2023-11-23 12:01:34,308 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
515
+ 2023-11-23 12:01:34,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
516
+ 2023-11-23 12:01:39,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
517
+ 2023-11-23 12:01:39,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
518
+ 2023-11-23 12:01:44,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
519
+ 2023-11-23 12:01:44,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
520
+ 2023-11-23 12:01:49,325 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
521
+ 2023-11-23 12:01:49,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
522
+ 2023-11-23 12:01:54,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
523
+ 2023-11-23 12:01:54,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
524
+ 2023-11-23 12:01:55,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats
525
+ 2023-11-23 12:01:59,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
526
+ 2023-11-23 12:02:00,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
527
+ 2023-11-23 12:02:04,328 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
528
+ 2023-11-23 12:02:05,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
529
+ 2023-11-23 12:02:09,338 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
530
+ 2023-11-23 12:02:10,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
531
+ 2023-11-23 12:02:14,339 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
532
+ 2023-11-23 12:02:15,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
533
+ 2023-11-23 12:02:19,340 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
534
+ 2023-11-23 12:02:20,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
535
+ 2023-11-23 12:02:24,341 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
536
+ 2023-11-23 12:02:25,846 DEBUG SenderThread:160 [sender.py:send():380] send: stats
537
+ 2023-11-23 12:02:26,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
538
+ 2023-11-23 12:02:29,346 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
539
+ 2023-11-23 12:02:31,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
540
+ 2023-11-23 12:02:34,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
541
+ 2023-11-23 12:02:36,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
542
+ 2023-11-23 12:02:39,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
543
+ 2023-11-23 12:02:41,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
544
+ 2023-11-23 12:02:44,364 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
545
+ 2023-11-23 12:02:46,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
546
+ 2023-11-23 12:02:49,365 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
547
+ 2023-11-23 12:02:51,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
548
+ 2023-11-23 12:02:54,367 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
549
+ 2023-11-23 12:02:55,847 DEBUG SenderThread:160 [sender.py:send():380] send: stats
550
+ 2023-11-23 12:02:57,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
551
+ 2023-11-23 12:02:59,368 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
552
+ 2023-11-23 12:03:02,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
553
+ 2023-11-23 12:03:04,369 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
554
+ 2023-11-23 12:03:07,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
555
+ 2023-11-23 12:03:09,389 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
556
+ 2023-11-23 12:03:12,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
557
+ 2023-11-23 12:03:13,790 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history
558
+ 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send():380] send: history
559
+ 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record
560
+ 2023-11-23 12:03:13,792 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end
561
+ 2023-11-23 12:03:14,124 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json
562
+ 2023-11-23 12:03:14,390 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
563
+ 2023-11-23 12:03:18,793 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
564
+ 2023-11-23 12:03:19,612 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
565
+ 2023-11-23 12:03:23,794 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
566
+ 2023-11-23 12:03:25,848 DEBUG SenderThread:160 [sender.py:send():380] send: stats
567
+ 2023-11-23 12:03:28,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
568
+ 2023-11-23 12:03:33,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
569
+ 2023-11-23 12:03:36,237 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
570
+ 2023-11-23 12:03:38,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
571
+ 2023-11-23 12:03:41,239 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
wandb/run-20231123_114355-4953ljim/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0, "train/learning_rate": 2e-05, "train/epoch": 0.2, "train/global_step": 1000, "_timestamp": 1700740607.3005545, "_runtime": 771.9938724040985, "_step": 1}
 
1
+ {"train/loss": 0.0, "train/learning_rate": 2e-05, "train/epoch": 0.3, "train/global_step": 1500, "_timestamp": 1700740993.7902756, "_runtime": 1158.4835934638977, "_step": 2}
wandb/run-20231123_114355-4953ljim/logs/debug-internal.log CHANGED
@@ -401,3 +401,171 @@
401
  2023-11-23 11:57:09,134 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
402
  2023-11-23 11:57:10,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
403
  2023-11-23 11:57:14,135 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
401
  2023-11-23 11:57:09,134 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
402
  2023-11-23 11:57:10,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
403
  2023-11-23 11:57:14,135 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
404
+ 2023-11-23 11:57:15,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
405
+ 2023-11-23 11:57:19,136 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
406
+ 2023-11-23 11:57:20,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
407
+ 2023-11-23 11:57:24,137 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
408
+ 2023-11-23 11:57:25,838 DEBUG SenderThread:160 [sender.py:send():380] send: stats
409
+ 2023-11-23 11:57:26,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
410
+ 2023-11-23 11:57:29,148 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
411
+ 2023-11-23 11:57:31,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
412
+ 2023-11-23 11:57:34,157 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
413
+ 2023-11-23 11:57:36,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
414
+ 2023-11-23 11:57:39,163 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
415
+ 2023-11-23 11:57:41,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
416
+ 2023-11-23 11:57:44,164 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
417
+ 2023-11-23 11:57:46,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
418
+ 2023-11-23 11:57:49,166 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
419
+ 2023-11-23 11:57:51,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
420
+ 2023-11-23 11:57:54,167 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
421
+ 2023-11-23 11:57:55,839 DEBUG SenderThread:160 [sender.py:send():380] send: stats
422
+ 2023-11-23 11:57:57,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
423
+ 2023-11-23 11:57:59,172 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
424
+ 2023-11-23 11:58:02,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
425
+ 2023-11-23 11:58:04,176 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
426
+ 2023-11-23 11:58:07,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
427
+ 2023-11-23 11:58:09,177 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
428
+ 2023-11-23 11:58:12,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
429
+ 2023-11-23 11:58:14,192 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
430
+ 2023-11-23 11:58:17,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
431
+ 2023-11-23 11:58:19,193 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
432
+ 2023-11-23 11:58:22,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
433
+ 2023-11-23 11:58:24,201 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
434
+ 2023-11-23 11:58:25,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats
435
+ 2023-11-23 11:58:28,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
436
+ 2023-11-23 11:58:29,202 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
437
+ 2023-11-23 11:58:33,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
438
+ 2023-11-23 11:58:34,203 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
439
+ 2023-11-23 11:58:38,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
440
+ 2023-11-23 11:58:39,204 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
441
+ 2023-11-23 11:58:43,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
442
+ 2023-11-23 11:58:44,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
443
+ 2023-11-23 11:58:48,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
444
+ 2023-11-23 11:58:49,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
445
+ 2023-11-23 11:58:53,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
446
+ 2023-11-23 11:58:54,215 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
447
+ 2023-11-23 11:58:55,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats
448
+ 2023-11-23 11:58:59,216 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
449
+ 2023-11-23 11:58:59,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
450
+ 2023-11-23 11:59:04,217 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
451
+ 2023-11-23 11:59:04,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
452
+ 2023-11-23 11:59:09,223 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
453
+ 2023-11-23 11:59:09,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
454
+ 2023-11-23 11:59:14,224 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
455
+ 2023-11-23 11:59:14,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
456
+ 2023-11-23 11:59:19,225 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
457
+ 2023-11-23 11:59:19,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
458
+ 2023-11-23 11:59:24,226 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
459
+ 2023-11-23 11:59:24,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
460
+ 2023-11-23 11:59:25,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats
461
+ 2023-11-23 11:59:29,227 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
462
+ 2023-11-23 11:59:30,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
463
+ 2023-11-23 11:59:34,231 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
464
+ 2023-11-23 11:59:35,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
465
+ 2023-11-23 11:59:39,232 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
466
+ 2023-11-23 11:59:40,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
467
+ 2023-11-23 11:59:44,241 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
468
+ 2023-11-23 11:59:45,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
469
+ 2023-11-23 11:59:49,246 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
470
+ 2023-11-23 11:59:50,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
471
+ 2023-11-23 11:59:54,247 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
472
+ 2023-11-23 11:59:55,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats
473
+ 2023-11-23 11:59:56,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
474
+ 2023-11-23 11:59:59,251 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
475
+ 2023-11-23 12:00:01,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
476
+ 2023-11-23 12:00:04,258 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
477
+ 2023-11-23 12:00:06,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
478
+ 2023-11-23 12:00:09,259 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
479
+ 2023-11-23 12:00:11,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
480
+ 2023-11-23 12:00:14,263 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
481
+ 2023-11-23 12:00:16,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
482
+ 2023-11-23 12:00:19,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
483
+ 2023-11-23 12:00:21,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
484
+ 2023-11-23 12:00:24,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
485
+ 2023-11-23 12:00:25,843 DEBUG SenderThread:160 [sender.py:send():380] send: stats
486
+ 2023-11-23 12:00:27,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
487
+ 2023-11-23 12:00:29,272 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
488
+ 2023-11-23 12:00:32,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
489
+ 2023-11-23 12:00:34,295 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
490
+ 2023-11-23 12:00:37,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
491
+ 2023-11-23 12:00:39,296 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
492
+ 2023-11-23 12:00:42,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
493
+ 2023-11-23 12:00:44,297 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
494
+ 2023-11-23 12:00:47,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
495
+ 2023-11-23 12:00:49,298 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
496
+ 2023-11-23 12:00:52,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
497
+ 2023-11-23 12:00:54,299 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
498
+ 2023-11-23 12:00:55,844 DEBUG SenderThread:160 [sender.py:send():380] send: stats
499
+ 2023-11-23 12:00:58,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
500
+ 2023-11-23 12:00:59,300 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
501
+ 2023-11-23 12:01:03,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
502
+ 2023-11-23 12:01:04,302 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
503
+ 2023-11-23 12:01:08,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
504
+ 2023-11-23 12:01:09,303 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
505
+ 2023-11-23 12:01:13,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
506
+ 2023-11-23 12:01:14,304 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
507
+ 2023-11-23 12:01:18,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
508
+ 2023-11-23 12:01:19,305 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
509
+ 2023-11-23 12:01:23,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
510
+ 2023-11-23 12:01:24,306 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
511
+ 2023-11-23 12:01:25,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats
512
+ 2023-11-23 12:01:29,307 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
513
+ 2023-11-23 12:01:29,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
514
+ 2023-11-23 12:01:34,308 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
515
+ 2023-11-23 12:01:34,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
516
+ 2023-11-23 12:01:39,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
517
+ 2023-11-23 12:01:39,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
518
+ 2023-11-23 12:01:44,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
519
+ 2023-11-23 12:01:44,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
520
+ 2023-11-23 12:01:49,325 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
521
+ 2023-11-23 12:01:49,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
522
+ 2023-11-23 12:01:54,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
523
+ 2023-11-23 12:01:54,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
524
+ 2023-11-23 12:01:55,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats
525
+ 2023-11-23 12:01:59,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
526
+ 2023-11-23 12:02:00,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
527
+ 2023-11-23 12:02:04,328 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
528
+ 2023-11-23 12:02:05,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
529
+ 2023-11-23 12:02:09,338 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
530
+ 2023-11-23 12:02:10,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
531
+ 2023-11-23 12:02:14,339 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
532
+ 2023-11-23 12:02:15,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
533
+ 2023-11-23 12:02:19,340 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
534
+ 2023-11-23 12:02:20,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
535
+ 2023-11-23 12:02:24,341 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
536
+ 2023-11-23 12:02:25,846 DEBUG SenderThread:160 [sender.py:send():380] send: stats
537
+ 2023-11-23 12:02:26,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
538
+ 2023-11-23 12:02:29,346 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
539
+ 2023-11-23 12:02:31,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
540
+ 2023-11-23 12:02:34,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
541
+ 2023-11-23 12:02:36,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
542
+ 2023-11-23 12:02:39,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
543
+ 2023-11-23 12:02:41,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
544
+ 2023-11-23 12:02:44,364 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
545
+ 2023-11-23 12:02:46,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
546
+ 2023-11-23 12:02:49,365 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
547
+ 2023-11-23 12:02:51,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
548
+ 2023-11-23 12:02:54,367 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
549
+ 2023-11-23 12:02:55,847 DEBUG SenderThread:160 [sender.py:send():380] send: stats
550
+ 2023-11-23 12:02:57,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
551
+ 2023-11-23 12:02:59,368 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
552
+ 2023-11-23 12:03:02,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
553
+ 2023-11-23 12:03:04,369 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
554
+ 2023-11-23 12:03:07,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
555
+ 2023-11-23 12:03:09,389 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
556
+ 2023-11-23 12:03:12,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
557
+ 2023-11-23 12:03:13,790 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history
558
+ 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send():380] send: history
559
+ 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record
560
+ 2023-11-23 12:03:13,792 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end
561
+ 2023-11-23 12:03:14,124 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json
562
+ 2023-11-23 12:03:14,390 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
563
+ 2023-11-23 12:03:18,793 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
564
+ 2023-11-23 12:03:19,612 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
565
+ 2023-11-23 12:03:23,794 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
566
+ 2023-11-23 12:03:25,848 DEBUG SenderThread:160 [sender.py:send():380] send: stats
567
+ 2023-11-23 12:03:28,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
568
+ 2023-11-23 12:03:33,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
569
+ 2023-11-23 12:03:36,237 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
570
+ 2023-11-23 12:03:38,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report
571
+ 2023-11-23 12:03:41,239 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive
wandb/run-20231123_114355-4953ljim/run-4953ljim.wandb CHANGED
Binary files a/wandb/run-20231123_114355-4953ljim/run-4953ljim.wandb and b/wandb/run-20231123_114355-4953ljim/run-4953ljim.wandb differ