2023-11-23 11:43:55,306 INFO StreamThr :160 [internal.py:wandb_internal():86] W&B internal server running at pid: 160, started at: 2023-11-23 11:43:55.305470 2023-11-23 11:43:55,307 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status 2023-11-23 11:43:55,492 INFO WriterThread:160 [datastore.py:open_for_write():85] open: /kaggle/working/wandb/run-20231123_114355-4953ljim/run-4953ljim.wandb 2023-11-23 11:43:55,492 DEBUG SenderThread:160 [sender.py:send():380] send: header 2023-11-23 11:43:55,496 DEBUG SenderThread:160 [sender.py:send():380] send: run 2023-11-23 11:43:55,695 INFO SenderThread:160 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20231123_114355-4953ljim/files 2023-11-23 11:43:55,696 INFO SenderThread:160 [sender.py:_start_run_threads():1124] run started: 4953ljim with start time 1700739835.306682 2023-11-23 11:43:55,703 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: check_version 2023-11-23 11:43:55,703 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: check_version 2023-11-23 11:43:55,809 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: run_start 2023-11-23 11:43:55,813 DEBUG HandlerThread:160 [system_info.py:__init__():32] System info init 2023-11-23 11:43:55,813 DEBUG HandlerThread:160 [system_info.py:__init__():47] System info init done 2023-11-23 11:43:55,813 INFO HandlerThread:160 [system_monitor.py:start():194] Starting system monitor 2023-11-23 11:43:55,813 INFO SystemMonitor:160 [system_monitor.py:_start():158] Starting system asset monitoring threads 2023-11-23 11:43:55,814 INFO HandlerThread:160 [system_monitor.py:probe():214] Collecting system info 2023-11-23 11:43:55,814 INFO SystemMonitor:160 [interfaces.py:start():190] Started cpu monitoring 2023-11-23 11:43:55,814 INFO SystemMonitor:160 [interfaces.py:start():190] Started disk monitoring 2023-11-23 11:43:55,815 INFO SystemMonitor:160 [interfaces.py:start():190] Started gpu monitoring 2023-11-23 11:43:55,816 INFO SystemMonitor:160 [interfaces.py:start():190] Started memory monitoring 2023-11-23 11:43:55,817 INFO SystemMonitor:160 [interfaces.py:start():190] Started network monitoring 2023-11-23 11:43:55,823 DEBUG HandlerThread:160 [system_info.py:probe():196] Probing system 2023-11-23 11:43:55,826 DEBUG HandlerThread:160 [gitlib.py:_init_repo():56] git repository is invalid 2023-11-23 11:43:55,826 DEBUG HandlerThread:160 [system_info.py:probe():244] Probing system done 2023-11-23 11:43:55,826 DEBUG HandlerThread:160 [system_monitor.py:probe():223] {'os': 'Linux-5.15.133+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2023-11-23T11:43:55.823512', 'startedAt': '2023-11-23T11:43:55.299457', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': 'c7ac5a6dfa40', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.194, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.194, 'min': 0.0, 'max': 0.0}, {'current': 2000.194, 'min': 0.0, 'max': 0.0}, {'current': 2000.194, 'min': 0.0, 'max': 0.0}, {'current': 2000.194, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5177.147869110107}}, 'gpu': 'Tesla P100-PCIE-16GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla P100-PCIE-16GB', 'memory_total': 17071734784}], 'memory': {'total': 31.357559204101562}} 2023-11-23 11:43:55,826 INFO HandlerThread:160 [system_monitor.py:probe():224] Finished collecting system info 2023-11-23 11:43:55,826 INFO HandlerThread:160 [system_monitor.py:probe():227] Publishing system info 2023-11-23 11:43:55,826 DEBUG HandlerThread:160 [system_info.py:_save_pip():52] Saving list of pip packages installed into the current environment 2023-11-23 11:43:55,828 DEBUG HandlerThread:160 [system_info.py:_save_pip():68] Saving pip packages done 2023-11-23 11:43:55,828 DEBUG HandlerThread:160 [system_info.py:_save_conda():75] Saving list of conda packages installed into the current environment 2023-11-23 11:43:56,698 INFO Thread-12 :160 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/requirements.txt 2023-11-23 11:43:56,698 INFO Thread-12 :160 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/conda-environment.yaml 2023-11-23 11:44:44,712 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/conda-environment.yaml 2023-11-23 11:44:45,266 DEBUG HandlerThread:160 [system_info.py:_save_conda():87] Saving conda packages done 2023-11-23 11:44:45,267 INFO HandlerThread:160 [system_monitor.py:probe():229] Finished publishing system info 2023-11-23 11:44:45,276 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,277 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: stop_status 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: internal_messages 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,278 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:45,279 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:45,280 DEBUG SenderThread:160 [sender.py:send():380] send: telemetry 2023-11-23 11:44:45,280 DEBUG SenderThread:160 [sender.py:send():380] send: config 2023-11-23 11:44:45,281 DEBUG SenderThread:160 [sender.py:send():380] send: metric 2023-11-23 11:44:45,281 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: stop_status 2023-11-23 11:44:45,363 DEBUG SenderThread:160 [sender.py:send():380] send: telemetry 2023-11-23 11:44:45,363 DEBUG SenderThread:160 [sender.py:send():380] send: metric 2023-11-23 11:44:45,363 WARNING SenderThread:160 [sender.py:send_metric():1331] Seen metric with glob (shouldn't happen) 2023-11-23 11:44:45,363 DEBUG SenderThread:160 [sender.py:send():380] send: telemetry 2023-11-23 11:44:45,364 DEBUG SenderThread:160 [sender.py:send():380] send: files 2023-11-23 11:44:45,364 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-metadata.json with policy now 2023-11-23 11:44:45,712 INFO Thread-12 :160 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/output.log 2023-11-23 11:44:45,712 INFO Thread-12 :160 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-metadata.json 2023-11-23 11:44:45,741 INFO wandb-upload_0:160 [upload_job.py:push():131] Uploaded file /tmp/tmp0_u_d4qewandb/t401mfun-wandb-metadata.json 2023-11-23 11:44:45,875 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:46,364 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:47,713 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/output.log 2023-11-23 11:44:50,876 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:51,365 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:55,817 DEBUG SystemMonitor:160 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2023-11-23 11:44:55,818 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:44:55,882 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:44:56,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:44:57,717 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/config.yaml 2023-11-23 11:45:00,883 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:01,978 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:05,887 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:06,979 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:10,888 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:11,980 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:15,889 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:16,981 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:20,890 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:21,982 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:25,820 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:45:25,891 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:27,820 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:30,892 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:32,821 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:35,893 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:37,822 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:40,895 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:42,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:45,896 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:47,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:50,897 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:52,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:45:55,820 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:45:55,898 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:45:58,821 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:00,907 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:03,822 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:05,908 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:08,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:10,908 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:13,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:15,910 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:18,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:20,911 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:23,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:25,821 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:46:25,914 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:29,822 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:30,917 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:34,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:35,918 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:39,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:40,919 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:44,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:45,920 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:49,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:50,941 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:46:54,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:46:55,822 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:46:55,966 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:00,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:00,967 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:05,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:05,989 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:10,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:11,011 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:15,826 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:16,012 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:20,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:21,014 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:25,823 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:47:26,016 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:26,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:31,017 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:31,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:36,018 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:36,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:41,019 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:41,826 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:46,020 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:46,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:51,023 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:51,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:47:55,824 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:47:56,024 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:47:57,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:01,025 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:02,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:06,031 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:07,826 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:11,034 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:12,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:16,035 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:17,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:21,045 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:22,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:25,824 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:48:26,046 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:28,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:31,050 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:33,826 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:36,051 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:38,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:41,052 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:43,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:46,053 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:48,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:51,056 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:53,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:48:55,825 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:48:56,057 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:48:59,826 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:01,058 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:04,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:06,059 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:09,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:11,062 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:14,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:16,062 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:19,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:21,063 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:24,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:25,826 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:49:26,066 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:30,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:31,067 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:35,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:36,070 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:40,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:41,071 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:45,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:46,072 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:50,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:49:51,073 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:55,826 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:49:56,074 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:49:56,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:01,075 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:01,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:06,076 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:06,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:11,077 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:11,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:16,078 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:16,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:21,079 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:21,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:25,827 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:50:26,088 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:27,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:31,088 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:32,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:33,461 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history 2023-11-23 11:50:33,464 DEBUG SenderThread:160 [sender.py:send():380] send: metric 2023-11-23 11:50:33,464 DEBUG SenderThread:160 [sender.py:send():380] send: metric 2023-11-23 11:50:33,464 DEBUG SenderThread:160 [sender.py:send():380] send: metric 2023-11-23 11:50:33,464 DEBUG SenderThread:160 [sender.py:send():380] send: history 2023-11-23 11:50:33,464 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record 2023-11-23 11:50:33,465 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end 2023-11-23 11:50:33,838 INFO Thread-12 :160 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json 2023-11-23 11:50:38,397 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:38,471 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:38,840 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/config.yaml 2023-11-23 11:50:43,399 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:43,619 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:48,403 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:48,620 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:53,404 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:53,622 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:50:55,828 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:50:58,406 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:50:58,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:03,408 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:03,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:08,423 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:08,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:13,424 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:13,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:18,426 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:18,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:23,430 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:23,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:25,829 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:51:28,432 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:29,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:33,434 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:34,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:38,434 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:39,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:43,438 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:44,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:48,445 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:49,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:53,446 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:51:54,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:51:55,829 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:51:58,466 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:00,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:03,467 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:05,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:08,471 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:10,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:13,472 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:15,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:18,473 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:20,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:23,492 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:25,830 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:52:26,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:28,493 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:31,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:33,494 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:36,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:38,499 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:41,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:43,500 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:46,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:48,501 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:51,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:53,502 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:52:55,831 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:52:57,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:52:58,503 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:02,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:03,504 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:07,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:08,505 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:12,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:13,506 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:17,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:18,507 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:22,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:23,516 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:25,832 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:53:28,517 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:28,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:33,525 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:33,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:38,526 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:38,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:43,527 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:43,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:48,528 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:48,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:53,530 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:53,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:53:55,832 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:53:58,550 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:53:59,834 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:03,554 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:04,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:08,554 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:09,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:13,557 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:14,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:18,561 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:19,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:23,562 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:24,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:25,833 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:54:28,563 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:30,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:33,564 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:35,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:38,565 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:40,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:43,566 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:45,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:48,579 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:50,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:53,580 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:54:55,834 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:54:56,835 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:54:58,581 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:01,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:03,582 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:06,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:08,583 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:11,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:13,589 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:16,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:18,590 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:21,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:23,597 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:25,835 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:55:27,836 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:28,598 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:32,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:33,600 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:37,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:38,601 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:42,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:43,602 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:47,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:48,604 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:52,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:55:53,606 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:55,836 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:55:58,607 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:55:58,837 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:03,610 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:03,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:08,611 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:08,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:13,613 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:13,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:18,614 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:18,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:23,623 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:23,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:25,837 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:56:28,624 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:29,838 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:33,625 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:34,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:38,634 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:39,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:43,635 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:44,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:47,301 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history 2023-11-23 11:56:47,302 DEBUG SenderThread:160 [sender.py:send():380] send: history 2023-11-23 11:56:47,302 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record 2023-11-23 11:56:47,303 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end 2023-11-23 11:56:47,982 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json 2023-11-23 11:56:48,637 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:50,304 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:54,131 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:56:55,305 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:56:55,837 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:56:59,132 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:00,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:04,133 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:05,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:09,134 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:10,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:14,135 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:15,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:19,136 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:20,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:24,137 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:25,838 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:57:26,839 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:29,148 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:31,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:34,157 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:36,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:39,163 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:41,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:44,164 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:46,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:49,166 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:51,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:54,167 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:57:55,839 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:57:57,840 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:57:59,172 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:02,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:04,176 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:07,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:09,177 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:12,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:14,192 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:17,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:19,193 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:22,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:24,201 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:25,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:58:28,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:29,202 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:33,841 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:34,203 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:38,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:39,204 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:43,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:44,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:48,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:49,213 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:53,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:58:54,215 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:55,840 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:58:59,216 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:58:59,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:04,217 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:04,842 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:09,223 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:09,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:14,224 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:14,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:19,225 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:19,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:24,226 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:24,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:25,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:59:29,227 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:30,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:34,231 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:35,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:39,232 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:40,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:44,241 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:45,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:49,246 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:50,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:54,247 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 11:59:55,842 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 11:59:56,843 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 11:59:59,251 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:01,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:04,258 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:06,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:09,259 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:11,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:14,263 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:16,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:19,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:21,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:24,264 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:25,843 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:00:27,844 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:29,272 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:32,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:34,295 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:37,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:39,296 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:42,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:44,297 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:47,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:49,298 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:52,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:54,299 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:00:55,844 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:00:58,845 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:00:59,300 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:03,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:04,302 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:08,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:09,303 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:13,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:14,304 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:18,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:19,305 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:23,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:24,306 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:25,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:01:29,307 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:29,846 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:34,308 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:34,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:39,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:39,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:44,311 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:44,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:49,325 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:49,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:54,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:01:54,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:01:55,845 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:01:59,327 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:00,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:04,328 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:05,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:09,338 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:10,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:14,339 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:15,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:19,340 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:20,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:24,341 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:25,846 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:02:26,847 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:29,346 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:31,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:34,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:36,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:39,347 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:41,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:44,364 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:46,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:49,365 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:51,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:54,367 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:02:55,847 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:02:57,848 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:02:59,368 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:02,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:04,369 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:07,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:09,389 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:12,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:13,790 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send():380] send: history 2023-11-23 12:03:13,792 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record 2023-11-23 12:03:13,792 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end 2023-11-23 12:03:14,124 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json 2023-11-23 12:03:14,390 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:18,793 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:19,612 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:23,794 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:25,848 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:03:28,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:33,849 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:36,237 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:38,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:41,239 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:43,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:46,243 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:48,852 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:51,244 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:53,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:03:55,855 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:03:56,245 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:03:58,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:01,251 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:03,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:06,252 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:08,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:11,253 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:13,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:16,254 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:18,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:21,266 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:23,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:25,849 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:04:26,267 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:29,850 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:31,271 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:34,851 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:36,288 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:39,852 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:41,289 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:44,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:46,290 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:49,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:51,312 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:04:54,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:04:55,851 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:04:56,313 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:00,852 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:01,316 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:05,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:06,317 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:10,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:11,319 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:15,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:16,320 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:20,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:21,321 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:25,851 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:05:26,322 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:26,852 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:31,323 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:31,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:36,331 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:36,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:41,339 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:41,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:46,340 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:46,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:51,345 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:51,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:05:55,851 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:05:56,346 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:05:57,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:01,351 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:02,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:06,357 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:07,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:11,358 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:12,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:16,370 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:17,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:21,371 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:22,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:25,852 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:06:26,375 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:28,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:31,376 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:33,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:36,379 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:38,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:41,380 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:43,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:46,382 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:48,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:51,383 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:53,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:06:55,853 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:06:56,384 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:06:59,854 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:01,385 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:04,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:06,386 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:09,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:11,388 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:14,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:16,399 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:19,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:21,400 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:24,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:25,854 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:07:26,403 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:30,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:31,409 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:35,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:36,410 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:40,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:41,411 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:45,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:46,412 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:50,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:07:51,413 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:55,855 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:07:56,414 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:07:56,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:01,415 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:01,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:06,416 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:06,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:11,417 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:11,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:16,418 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:16,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:21,419 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:21,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:25,855 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:08:26,420 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:27,856 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:31,421 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:32,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:36,424 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:37,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:41,429 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:42,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:46,430 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:47,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:51,433 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:52,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:08:55,856 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:08:56,434 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:08:58,857 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:01,439 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:03,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:06,441 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:08,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:11,441 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:13,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:16,449 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:18,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:21,450 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:23,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:25,857 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:09:26,467 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:29,858 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:31,468 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:34,859 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:36,469 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:39,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:41,470 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:41,877 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history 2023-11-23 12:09:41,878 DEBUG SenderThread:160 [sender.py:send():380] send: history 2023-11-23 12:09:41,878 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record 2023-11-23 12:09:41,878 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end 2023-11-23 12:09:42,297 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json 2023-11-23 12:09:44,879 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:46,687 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:49,880 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:51,688 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:09:54,881 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:09:55,858 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:09:56,689 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:00,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:01,700 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:05,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:06,702 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:10,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:11,703 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:15,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:16,704 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:20,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:21,705 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:25,859 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:10:26,706 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:26,860 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:31,707 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:31,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:36,708 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:36,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:41,716 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:41,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:46,716 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:46,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:51,725 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:51,864 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:10:55,860 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:10:56,726 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:10:57,861 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:01,736 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:02,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:06,737 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:07,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:11,739 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:12,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:16,741 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:17,864 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:21,742 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:22,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:25,861 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:11:26,743 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:28,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:31,744 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:33,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:36,745 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:38,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:41,746 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:43,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:46,751 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:48,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:51,755 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:53,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:11:55,861 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:11:56,756 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:11:59,862 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:01,762 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:04,863 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:06,763 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:09,864 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:11,764 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:14,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:16,769 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:19,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:21,770 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:24,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:25,862 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:12:26,774 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:30,864 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:31,775 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:35,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:36,778 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:40,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:41,782 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:45,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:46,783 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:50,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:12:51,786 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:55,863 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:12:56,805 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:12:56,864 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:01,806 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:01,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:06,813 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:06,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:11,814 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:11,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:16,818 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:16,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:21,819 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:21,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:25,864 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:13:26,821 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:27,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:31,822 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:32,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:36,823 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:37,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:41,824 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:42,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:46,825 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:47,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:51,827 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:52,870 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:13:55,865 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:13:56,828 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:13:58,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:01,829 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:03,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:06,830 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:08,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:11,831 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:13,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:16,832 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:18,870 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:21,833 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:23,871 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:25,865 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:14:26,853 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:29,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:31,855 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:34,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:36,865 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:39,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:41,866 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:44,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:46,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:49,870 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:51,997 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:14:54,871 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:14:55,866 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:14:56,998 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:00,867 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:02,000 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:05,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:07,001 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:10,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:12,002 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:15,870 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:17,003 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:20,871 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:22,022 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:25,867 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:15:26,868 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:27,023 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:31,869 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:32,024 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:36,870 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:37,025 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:41,871 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:42,026 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:46,872 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:47,027 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:51,873 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:52,037 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:15:55,868 DEBUG SenderThread:160 [sender.py:send():380] send: stats 2023-11-23 12:15:55,939 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: partial_history 2023-11-23 12:15:55,940 DEBUG SenderThread:160 [sender.py:send():380] send: history 2023-11-23 12:15:55,940 DEBUG SenderThread:160 [sender.py:send_request():407] send_request: summary_record 2023-11-23 12:15:55,941 INFO SenderThread:160 [sender.py:_save_file():1380] saving file wandb-summary.json with policy end 2023-11-23 12:15:56,443 INFO Thread-12 :160 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231123_114355-4953ljim/files/wandb-summary.json 2023-11-23 12:15:56,941 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:15:57,143 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:16:01,942 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:16:02,786 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:16:06,943 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:16:07,788 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:16:11,944 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:16:12,789 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive 2023-11-23 12:16:16,945 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: status_report 2023-11-23 12:16:17,795 DEBUG HandlerThread:160 [handler.py:handle_request():146] handle_request: keepalive