2024-06-15 11:45:19,784 INFO StreamThr :2088494 [internal.py:wandb_internal():85] W&B internal server running at pid: 2088494, started at: 2024-06-15 11:45:19.771525 2024-06-15 11:45:19,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status 2024-06-15 11:45:19,786 INFO WriterThread:2088494 [datastore.py:open_for_write():87] open: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/run-wfpe2teb.wandb 2024-06-15 11:45:19,793 DEBUG SenderThread:2088494 [sender.py:send():379] send: header 2024-06-15 11:45:19,819 DEBUG SenderThread:2088494 [sender.py:send():379] send: run 2024-06-15 11:45:20,181 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: check_version 2024-06-15 11:45:20,186 INFO SenderThread:2088494 [dir_watcher.py:__init__():211] watching files in: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files 2024-06-15 11:45:20,186 INFO SenderThread:2088494 [sender.py:_start_run_threads():1188] run started: wfpe2teb with start time 1718451919.779791 2024-06-15 11:45:20,186 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: check_version 2024-06-15 11:45:20,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: run_start 2024-06-15 11:45:20,329 DEBUG HandlerThread:2088494 [system_info.py:__init__():26] System info init 2024-06-15 11:45:20,329 DEBUG HandlerThread:2088494 [system_info.py:__init__():41] System info init done 2024-06-15 11:45:20,330 INFO HandlerThread:2088494 [system_monitor.py:start():194] Starting system monitor 2024-06-15 11:45:20,330 INFO SystemMonitor:2088494 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-06-15 11:45:20,330 INFO HandlerThread:2088494 [system_monitor.py:probe():214] Collecting system info 2024-06-15 11:45:20,330 INFO SystemMonitor:2088494 [interfaces.py:start():188] Started cpu monitoring 2024-06-15 11:45:20,331 INFO SystemMonitor:2088494 [interfaces.py:start():188] Started disk monitoring 2024-06-15 11:45:20,332 INFO SystemMonitor:2088494 [interfaces.py:start():188] Started gpu monitoring 2024-06-15 11:45:20,332 INFO SystemMonitor:2088494 [interfaces.py:start():188] Started memory monitoring 2024-06-15 11:45:20,333 INFO SystemMonitor:2088494 [interfaces.py:start():188] Started network monitoring 2024-06-15 11:45:20,346 DEBUG HandlerThread:2088494 [system_info.py:probe():152] Probing system 2024-06-15 11:45:20,347 DEBUG HandlerThread:2088494 [gitlib.py:_init_repo():56] git repository is invalid 2024-06-15 11:45:20,347 DEBUG HandlerThread:2088494 [system_info.py:probe():200] Probing system done 2024-06-15 11:45:20,347 DEBUG HandlerThread:2088494 [system_monitor.py:probe():223] {'os': 'Linux-5.15.0-1058-azure-x86_64-with-glibc2.29', 'python': '3.8.10', 'heartbeatAt': '2024-06-15T11:45:20.346816', 'startedAt': '2024-06-15T11:45:19.278284', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'train_lora.py', 'codePathLocal': 'train_lora.py', 'codePath': 'train_lora.py', 'host': 'jupyternotebook-voice-intern-857cd585b4-9428r', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 96, 'cpu_count_logical': 96, 'cpu_freq': {'current': 2477.823895833337, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 3413.611, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 3162.597, 'min': 0.0, 'max': 0.0}, {'current': 3372.503, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2445.431, 'min': 0.0, 'max': 0.0}, {'current': 2942.731, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 174.2662811279297, 'used': 141.74878311157227}}, 'gpu': 'NVIDIA A100 80GB PCIe', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA A100 80GB PCIe', 'memory_total': 85899345920}], 'memory': {'total': 866.1124496459961}} 2024-06-15 11:45:20,347 INFO HandlerThread:2088494 [system_monitor.py:probe():224] Finished collecting system info 2024-06-15 11:45:20,347 INFO HandlerThread:2088494 [system_monitor.py:probe():227] Publishing system info 2024-06-15 11:45:20,403 INFO HandlerThread:2088494 [system_monitor.py:probe():229] Finished publishing system info 2024-06-15 11:45:20,407 DEBUG SenderThread:2088494 [sender.py:send():379] send: files 2024-06-15 11:45:20,407 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now 2024-06-15 11:45:20,651 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: python_packages 2024-06-15 11:45:20,651 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: python_packages 2024-06-15 11:45:20,652 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:45:20,654 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:20,737 INFO wandb-upload_0:2088494 [upload_job.py:push():130] Uploaded file /tmp/tmphdd6asnxwandb/k63hxt9h-wandb-metadata.json 2024-06-15 11:45:20,748 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:45:20,837 DEBUG SenderThread:2088494 [sender.py:send():379] send: telemetry 2024-06-15 11:45:21,342 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_created():271] file/dir created: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-metadata.json 2024-06-15 11:45:21,342 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_created():271] file/dir created: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/requirements.txt 2024-06-15 11:45:21,652 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:22,652 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:23,652 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:24,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:24,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:25,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:26,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:27,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:28,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:29,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:30,653 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:30,654 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:31,654 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:32,654 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:33,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:34,205 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_created():271] file/dir created: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/output.log 2024-06-15 11:45:34,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:35,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:35,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:45:35,665 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:45:35,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:36,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:37,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:37,910 DEBUG SenderThread:2088494 [sender.py:send():379] send: config 2024-06-15 11:45:37,911 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:37,911 DEBUG SenderThread:2088494 [sender.py:send():379] send: telemetry 2024-06-15 11:45:37,911 DEBUG SenderThread:2088494 [sender.py:send():379] send: telemetry 2024-06-15 11:45:37,911 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:37,911 WARNING SenderThread:2088494 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen) 2024-06-15 11:45:37,911 DEBUG SenderThread:2088494 [sender.py:send():379] send: telemetry 2024-06-15 11:45:38,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:39,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:40,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:40,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:41,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:42,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:43,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:44,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:45,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:45,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:46,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:47,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:48,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:49,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:50,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:45:50,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:45:50,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:50,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:51,530 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml 2024-06-15 11:45:51,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:52,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:53,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:54,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:55,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:56,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:45:56,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:57,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:45:57,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:57,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:57,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:57,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:45:57,583 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:45:57,583 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:45:57,626 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:45:57,651 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_created():271] file/dir created: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:45:57,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:58,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:45:59,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:00,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:01,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:02,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:02,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:03,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:04,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:05,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:46:05,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:46:05,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:06,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:07,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:07,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:08,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:09,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:10,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:11,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:12,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:12,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:13,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:14,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:15,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:46:15,405 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:46:15,406 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:46:15,441 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:46:15,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:16,064 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:46:16,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:17,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:17,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:18,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:19,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:20,333 DEBUG SystemMonitor:2088494 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-06-15 11:46:20,334 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:46:20,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:46:20,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:46:20,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:21,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:22,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:23,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:23,243 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml 2024-06-15 11:46:23,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:24,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:25,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:26,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:27,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:28,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:28,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:29,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:30,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:31,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:32,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:33,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:33,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:34,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:46:34,313 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:46:34,314 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:46:34,363 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:46:34,476 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:46:34,955 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:35,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:46:35,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:46:35,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:36,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:37,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:38,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:38,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:39,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:40,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:41,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:43,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:43,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:43,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:44,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:45,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:46,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:47,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:48,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:49,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:49,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:50,342 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:46:50,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:46:50,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:46:50,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:51,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:52,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:46:52,469 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:46:52,470 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:46:52,517 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:46:52,935 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:46:52,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:53,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:54,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:55,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:46:55,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:56,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:57,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:58,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:46:59,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:00,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:00,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:01,987 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:02,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:03,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:04,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:05,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:47:05,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:47:05,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:05,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:06,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:07,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:08,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:09,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:47:09,521 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:47:09,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:47:09,565 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:47:09,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:10,290 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:47:10,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:10,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:11,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:12,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:13,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:14,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:15,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:15,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:16,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:17,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:18,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:19,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:20,337 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:47:20,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:47:20,725 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:47:20,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:20,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:21,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:22,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:23,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:24,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:25,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:25,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:26,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:47:26,506 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:47:26,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:47:26,560 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:47:26,660 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:47:26,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:28,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:29,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:30,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:31,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:31,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:32,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:33,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:34,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:35,116 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:35,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:47:35,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:47:36,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:36,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:37,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:38,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:39,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:40,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:41,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:41,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:42,131 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:43,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:44,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:47:44,122 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:47:44,122 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:47:44,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:44,167 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:47:45,101 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:47:45,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:46,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:47,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:47,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:48,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:49,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:50,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:50,338 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:47:50,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:47:50,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:47:51,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:52,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:53,135 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:53,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:54,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:55,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:56,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:57,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:58,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:47:59,134 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:47:59,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:00,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:01,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:01,532 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:48:01,533 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:48:01,534 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:48:01,572 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:48:02,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:02,528 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:48:03,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:04,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:04,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:05,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:05,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:48:05,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:48:06,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:07,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:08,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:09,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:09,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:10,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:11,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:12,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:13,154 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:14,180 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:15,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:15,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:16,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:17,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:18,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:19,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:19,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:48:19,693 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:48:19,694 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:48:19,736 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:48:19,906 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:48:20,340 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:48:20,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:20,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:20,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:48:20,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:48:21,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:22,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:23,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:24,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:25,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:25,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:26,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:27,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:28,486 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:29,486 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:30,486 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:30,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:31,486 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:32,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:33,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:34,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:35,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:35,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:48:35,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:48:35,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:36,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:37,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:38,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:48:38,162 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:48:38,162 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:48:38,199 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:48:38,321 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:48:38,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:39,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:40,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:40,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:41,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:42,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:43,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:44,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:45,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:45,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:46,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:47,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:48,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:49,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:50,341 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:48:50,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:50,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:48:50,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:48:50,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:51,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:52,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:53,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:54,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:55,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:56,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:48:56,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:57,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:58,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:48:59,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:00,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:01,115 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:01,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:02,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:03,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:04,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:05,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:05,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:49:05,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:49:06,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:06,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:07,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:08,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:09,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:10,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:11,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:11,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:12,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:13,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:14,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:15,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:16,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:16,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:17,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:18,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:19,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:20,342 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:49:20,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:20,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:49:20,729 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:49:21,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:21,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:22,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:23,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:24,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:25,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:26,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:26,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:27,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:49:27,264 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:49:27,264 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:49:27,265 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:49:27,265 DEBUG SenderThread:2088494 [sender.py:send():379] send: metric 2024-06-15 11:49:27,265 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:49:27,265 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:49:27,300 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:49:27,384 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:49:27,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:28,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:29,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:30,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:31,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:31,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:32,489 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml 2024-06-15 11:49:32,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:33,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:34,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:35,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:35,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:49:35,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:49:36,501 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:37,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:37,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:38,501 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:39,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:40,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:41,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:42,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:43,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:43,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:43,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:49:43,809 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:49:43,810 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:49:43,844 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:49:44,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:44,905 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:49:45,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:46,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:47,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:48,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:48,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:49,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:50,344 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:49:50,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:50,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:49:50,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:49:51,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:52,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:53,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:54,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:49:54,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:55,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:56,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:57,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:58,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:49:59,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:00,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:00,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:01,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:02,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:50:02,478 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:50:02,478 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:50:02,516 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:50:02,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:03,267 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:50:03,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:04,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:05,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:05,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:05,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:50:05,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:50:06,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:07,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:08,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:09,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:10,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:10,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:11,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:12,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:13,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:14,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:15,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:16,504 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:16,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:17,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:18,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:19,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:20,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:50:20,253 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:50:20,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:50:20,303 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:50:20,345 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:50:20,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:20,665 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:50:20,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:50:20,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:50:21,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:21,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:22,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:23,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:24,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:25,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:26,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:27,121 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:27,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:28,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:29,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:30,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:31,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:32,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:32,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:33,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:34,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:35,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:35,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:50:35,874 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:50:36,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:37,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:38,309 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:38,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:39,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:50:39,589 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:50:39,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:50:39,622 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:50:39,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:40,169 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:50:40,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:41,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:42,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:43,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:43,901 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:44,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:45,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:46,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:47,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:48,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:48,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:49,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:50,346 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:50:50,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:50,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:50:50,874 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:50:51,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:52,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:53,716 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:54,717 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:54,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:50:55,717 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:56,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:57,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:50:57,774 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:50:57,774 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:50:57,808 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:50:57,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:58,628 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:50:58,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:50:59,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:00,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:01,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:02,051 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:03,051 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:04,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:05,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:05,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:05,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:51:05,874 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:51:06,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:07,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:08,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:09,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:10,053 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:11,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:11,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:12,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:13,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:14,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:15,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:51:15,102 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:51:15,102 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:51:15,135 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:51:15,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:16,070 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:51:16,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:16,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:17,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:18,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:19,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:20,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:20,347 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:51:20,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:51:20,875 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:51:21,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:21,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:22,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:23,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:24,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:25,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:26,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:26,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:27,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:28,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:29,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:30,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:31,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:32,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:32,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:32,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:51:32,685 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:51:32,685 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:51:32,723 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:51:33,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:33,537 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:51:34,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:35,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:35,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:51:35,875 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:51:36,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:37,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:37,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:38,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:39,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:40,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:41,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:42,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:42,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:43,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:44,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:45,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:46,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:47,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:48,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:48,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:49,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:50,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:50,348 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:51:50,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:51:50,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:51:51,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:51:51,169 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:51:51,170 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:51:51,221 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:51:51,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:52,013 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:51:52,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:53,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:54,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:54,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:51:55,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:56,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:57,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:58,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:51:59,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:00,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:00,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:01,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:02,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:03,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:04,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:05,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:05,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:52:05,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:52:06,037 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:06,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:07,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:08,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:09,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:10,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:52:10,325 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:52:10,326 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:52:10,367 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:52:10,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:10,443 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:52:11,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:11,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:12,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:13,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:14,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:15,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:16,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:16,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:17,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:18,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:19,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:20,350 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:52:20,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:20,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:52:20,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:52:21,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:21,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:22,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:23,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:24,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:25,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:26,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:26,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:27,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:27,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:52:27,638 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:52:27,638 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:52:27,678 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:52:27,828 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:52:28,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:29,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:30,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:31,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:31,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:32,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:33,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:34,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:35,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:35,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:52:35,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:52:36,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:36,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:37,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:38,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:39,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:40,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:41,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:41,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:42,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:43,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:44,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:45,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:46,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:46,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:47,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:48,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:49,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:50,351 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:52:50,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:50,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:52:50,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:52:51,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:51,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:52,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:53,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:54,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:55,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:56,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:56,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:52:57,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:58,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:52:59,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:00,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:01,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:01,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:02,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:03,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:04,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:05,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:05,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:53:05,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:53:06,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:06,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:07,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:08,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:09,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:10,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:11,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:11,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:12,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:13,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:14,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:15,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:16,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:17,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:17,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:17,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:53:17,607 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:53:17,607 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:53:17,647 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:53:17,974 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:53:18,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:19,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:20,352 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:53:20,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:20,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:53:20,886 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:53:21,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:22,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:22,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:23,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:24,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:25,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:26,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:27,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:28,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:28,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:29,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:30,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:31,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:32,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:33,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:33,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:34,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:35,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:35,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:53:35,886 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:53:36,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:53:36,286 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:53:36,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:53:36,334 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:53:36,359 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:53:36,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:37,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:38,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:39,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:39,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:40,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:41,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:42,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:43,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:44,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:45,139 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:45,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:46,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:47,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:48,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:49,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:50,353 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:53:50,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:50,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:50,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:53:50,886 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:53:51,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:52,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:53,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:53,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:53:53,953 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:53:53,954 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:53:53,986 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:53:54,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:54,823 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:53:55,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:55,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:53:56,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:57,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:58,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:53:59,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:00,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:01,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:01,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:02,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:03,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:04,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:05,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:05,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:54:05,886 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:54:06,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:06,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:07,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:08,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:09,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:10,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:11,226 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:11,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:12,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:54:12,510 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:54:12,510 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:54:12,546 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:54:12,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:13,256 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:54:13,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:14,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:15,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:16,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:16,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:17,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:18,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:19,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:20,355 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:54:20,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:20,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:54:20,887 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:54:21,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:21,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:22,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:23,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:24,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:25,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:26,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:26,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:27,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:28,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:29,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:30,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:30,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:54:30,977 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:54:30,978 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:54:31,057 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:54:31,645 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:54:31,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:32,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:32,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:33,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:34,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:35,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:35,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:54:35,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:54:36,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:37,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:37,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:38,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:39,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:40,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:41,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:42,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:42,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:43,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:44,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:45,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:46,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:47,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:47,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:48,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:54:48,266 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:54:48,266 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:54:48,320 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:54:48,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:49,094 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:54:49,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:50,356 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:54:50,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:50,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:54:50,887 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:54:51,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:52,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:52,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:53,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:54,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:55,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:56,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:57,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:58,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:54:58,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:54:59,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:00,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:01,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:02,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:03,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:03,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:04,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:05,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:05,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:55:05,889 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:55:06,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:07,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:55:07,005 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:55:07,006 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:55:07,039 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:55:07,525 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:55:07,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:08,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:08,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:09,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:10,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:11,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:12,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:13,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:14,651 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:14,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:15,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:16,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:17,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:18,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:19,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:20,358 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:55:20,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:20,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:20,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:55:20,890 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:55:21,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:22,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:23,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:24,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:25,504 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:25,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:55:25,554 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:55:25,554 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:55:25,645 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:55:25,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:25,943 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:55:26,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:27,761 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:28,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:29,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:30,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:31,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:31,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:32,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:33,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:34,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:35,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:35,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:55:35,890 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:55:36,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:36,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:37,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:38,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:39,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:40,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:41,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:41,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:42,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:43,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:44,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:55:44,338 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:55:44,338 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:55:44,377 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:55:44,381 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:55:44,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:45,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:46,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:46,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:47,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:48,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:49,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:50,359 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:55:50,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:55:50,890 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:55:50,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:51,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:51,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:52,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:53,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:54,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:55,989 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:56,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:55:56,989 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:57,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:58,989 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:55:59,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:00,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:01,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:01,901 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:56:01,902 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:56:01,902 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:56:01,947 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:56:01,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:02,857 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:56:02,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:03,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:05,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:05,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:56:05,891 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:56:06,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:07,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:07,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:08,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:09,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:10,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:11,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:12,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:13,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:13,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:14,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:15,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:16,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:17,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:18,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:18,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:19,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:19,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:56:19,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:56:19,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:56:19,618 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:56:20,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:20,276 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:56:20,359 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:56:20,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:56:20,891 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:56:21,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:22,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:23,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:23,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:24,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:25,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:26,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:27,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:28,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:28,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:29,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:30,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:31,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:32,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:33,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:33,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:34,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:35,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:35,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:56:35,891 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:56:36,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:37,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:38,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:39,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:39,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:40,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:41,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:42,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:43,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:44,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:44,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:45,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:46,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:47,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:48,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:49,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:49,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:50,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:50,360 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:56:50,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:56:50,891 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:56:51,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:52,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:53,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:54,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:54,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:56:55,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:56,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:57,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:58,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:59,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:56:59,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:00,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:01,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:02,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:03,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:04,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:04,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:05,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:05,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:57:05,891 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:57:06,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:07,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:08,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:09,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:09,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:57:09,293 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:57:09,294 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:57:09,346 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:57:09,401 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:57:10,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:10,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:11,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:12,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:13,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:14,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:15,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:15,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:16,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:17,310 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:18,310 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:19,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:20,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:20,362 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:57:20,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:57:20,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:57:20,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:21,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:22,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:23,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:24,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:25,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:26,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:26,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:27,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:28,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:57:28,082 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:57:28,082 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:57:28,117 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:57:28,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:28,868 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:57:29,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:30,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:31,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:31,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:32,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:33,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:34,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:35,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:35,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:57:35,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:57:36,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:36,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:37,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:38,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:39,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:40,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:41,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:41,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:42,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:43,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:44,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:45,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:46,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:57:46,581 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:57:46,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:57:46,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:46,626 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:57:46,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:47,300 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:57:47,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:48,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:49,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:50,363 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:57:50,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:50,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:57:50,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:57:51,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:51,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:52,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:53,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:54,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:55,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:56,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:57,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:57:57,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:58,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:57:59,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:00,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:01,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:02,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:02,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:03,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:04,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:05,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:58:05,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:58:05,426 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:58:05,493 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:58:05,743 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:58:05,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:05,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:58:05,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:58:06,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:07,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:07,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:08,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:09,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:10,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:11,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:12,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:13,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:14,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:15,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:16,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:17,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:18,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:18,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:19,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:20,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:20,365 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:58:20,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:58:20,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:58:21,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:22,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:23,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:23,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:24,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:24,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:58:24,490 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:58:24,490 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:58:24,541 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:58:25,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:25,112 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:58:26,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:27,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:28,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:29,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:29,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:30,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:31,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:32,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:33,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:34,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:34,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:35,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:35,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:58:35,897 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:58:36,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:37,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:38,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:39,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:39,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:40,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:41,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:41,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:58:41,918 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:58:41,918 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:58:41,968 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:58:42,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:42,493 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:58:43,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:44,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:45,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:45,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:46,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:47,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:48,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:49,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:50,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:50,373 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:58:50,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:50,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:58:50,961 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:58:51,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:52,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:53,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:54,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:55,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:55,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:58:56,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:57,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:58,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:59,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:58:59,988 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:58:59,989 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:58:59,990 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:59:00,044 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:59:00,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:00,947 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:59:01,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:01,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:02,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:03,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:04,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:05,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:05,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:59:05,961 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:59:06,115 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:06,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:07,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:08,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:09,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:10,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:11,115 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:11,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:12,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:13,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:14,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:15,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:16,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:16,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:17,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:59:17,305 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:59:17,306 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:59:17,325 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:59:17,349 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:59:17,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:18,338 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:59:18,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:19,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:20,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:20,368 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:59:20,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:59:20,961 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:59:21,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:21,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:22,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:23,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:24,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:25,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:26,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:26,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:27,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:28,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:29,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:30,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:31,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:31,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:32,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:33,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:34,658 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:35,658 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:35,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:59:35,845 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:59:35,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:59:35,894 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:59:35,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:59:35,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:59:36,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:36,763 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:59:36,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:37,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:38,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:39,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:40,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:41,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:41,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:42,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:43,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:44,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:45,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:46,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:47,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:47,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:48,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:49,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:50,368 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 11:59:50,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:50,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 11:59:50,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 11:59:51,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:52,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:53,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:53,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:53,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 11:59:53,909 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 11:59:53,910 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 11:59:53,948 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 11:59:54,224 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 11:59:54,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:55,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:56,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:57,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:58,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 11:59:58,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 11:59:59,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:00,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:01,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:02,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:03,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:04,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:04,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:05,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:05,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:00:05,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:00:06,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:07,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:08,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:09,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:09,954 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:10,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:11,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:12,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:00:12,458 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:00:12,458 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:00:12,504 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:00:12,638 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:00:12,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:13,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:14,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:14,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:15,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:16,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:17,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:18,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:19,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:20,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:20,369 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:00:20,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:20,972 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:00:20,973 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:00:21,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:22,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:23,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:24,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:25,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:25,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:26,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:27,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:28,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:29,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:30,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:30,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:31,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:32,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:33,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:34,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:35,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:35,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:35,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:00:35,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:00:36,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:37,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:38,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:39,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:40,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:40,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:41,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:42,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:43,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:44,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:45,504 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:45,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:46,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:47,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:48,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:49,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:50,370 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:00:50,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:50,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:50,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:00:50,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:00:51,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:52,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:53,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:54,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:55,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:00:55,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:56,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:57,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:58,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:00:59,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:00,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:00,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:01,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:02,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:01:02,346 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:01:02,346 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:01:02,410 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:01:02,821 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:01:02,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:03,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:04,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:05,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:05,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:05,988 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:01:05,988 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:01:06,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:07,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:08,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:09,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:10,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:11,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:11,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:12,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:13,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:14,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:15,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:16,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:16,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:17,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:18,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:19,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:20,372 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:01:20,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:01:20,429 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:01:20,429 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:01:20,467 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:01:20,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:20,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:01:20,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:01:21,286 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:01:21,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:21,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:22,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:23,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:24,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:25,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:26,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:26,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:27,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:28,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:29,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:30,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:31,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:31,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:32,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:33,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:34,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:35,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:35,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:01:35,963 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:01:36,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:36,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:37,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:39,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:39,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:01:39,494 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:01:39,494 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:01:39,536 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:01:39,723 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:01:40,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:41,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:41,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:42,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:43,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:44,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:45,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:46,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:46,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:47,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:48,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:49,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:50,374 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:01:50,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:50,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:01:50,963 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:01:51,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:52,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:52,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:53,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:54,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:55,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:56,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:57,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:01:57,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:01:57,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:57,418 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:01:57,418 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:01:57,482 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:01:58,177 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:01:58,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:01:59,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:00,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:01,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:02,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:02,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:03,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:04,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:05,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:05,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:02:05,963 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:02:06,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:07,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:07,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:08,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:09,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:10,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:11,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:12,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:13,501 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:13,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:14,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:15,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:02:15,370 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:02:15,370 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:02:15,408 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:02:15,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:15,589 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:02:16,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:17,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:18,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:18,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:19,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:20,374 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:02:20,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:20,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:02:20,963 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:02:21,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:22,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:23,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:24,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:24,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:25,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:26,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:27,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:28,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:29,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:29,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:30,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:31,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:32,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:02:32,146 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:02:32,146 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:02:32,182 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:02:32,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:32,998 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:02:33,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:34,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:35,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:35,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:35,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:02:35,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:02:36,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:37,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:38,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:39,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:40,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:40,650 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:41,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:42,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:43,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:44,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:45,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:46,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:46,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:47,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:48,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:49,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:50,376 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:02:50,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:50,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:02:50,702 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:02:50,702 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:02:50,743 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:02:50,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:02:50,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:02:51,466 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:02:51,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:51,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:52,709 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:53,709 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:54,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:55,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:56,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:57,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:57,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:02:58,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:02:59,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:00,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:01,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:02,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:02,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:03,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:04,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:05,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:05,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:03:05,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:03:07,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:08,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:08,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:09,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:09,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:03:09,557 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:03:09,558 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:03:09,606 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:03:09,924 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:03:10,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:11,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:12,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:13,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:13,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:14,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:15,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:16,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:17,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:18,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:19,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:19,503 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:20,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:20,393 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:03:20,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:03:20,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:03:21,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:22,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:23,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:24,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:24,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:25,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:26,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:27,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:28,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:03:28,001 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:03:28,002 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:03:28,049 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:03:28,336 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:03:28,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:29,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:30,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:30,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:31,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:32,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:33,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:34,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:35,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:35,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:35,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:03:35,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:03:36,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:37,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:38,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:39,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:40,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:41,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:41,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:42,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:43,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:44,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:45,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:46,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:46,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:47,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:47,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:03:47,761 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:03:47,762 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:03:47,805 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:03:47,809 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:03:48,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:48,837 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:03:49,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:50,378 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:03:50,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:50,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:03:50,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:03:51,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:52,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:52,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:53,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:54,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:55,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:56,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:57,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:03:57,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:58,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:03:59,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:00,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:01,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:02,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:02,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:03,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:04,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:05,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:04:05,246 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:04:05,246 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:04:05,288 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:04:05,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:05,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:04:05,964 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:04:06,193 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:04:06,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:07,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:07,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:08,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:09,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:10,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:11,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:12,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:12,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:13,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:14,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:15,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:16,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:17,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:17,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:18,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:19,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:20,379 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:04:20,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:20,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:04:20,965 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:04:21,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:22,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:22,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:23,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:24,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:25,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:26,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:27,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:27,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:28,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:29,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:30,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:31,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:32,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:32,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:33,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:34,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:35,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:35,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:04:35,965 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:04:36,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:37,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:37,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:38,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:39,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:40,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:41,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:42,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:42,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:43,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:44,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:45,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:46,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:47,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:47,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:48,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:49,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:50,380 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:04:50,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:50,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:04:50,965 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:04:51,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:52,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:52,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:53,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:54,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:54,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:04:54,814 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:04:54,814 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:04:54,869 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:04:55,307 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:04:55,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:56,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:57,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:58,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:04:58,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:04:59,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:00,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:01,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:02,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:03,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:03,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:04,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:05,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:05,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:05:05,965 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:05:06,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:07,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:08,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:09,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:09,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:10,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:11,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:12,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:12,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:05:12,918 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:05:12,918 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:05:12,953 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:05:13,633 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:13,724 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:05:14,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:14,633 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:15,646 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:16,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:17,646 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:18,646 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:19,647 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:20,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:20,381 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:05:20,646 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:20,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:05:20,965 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:05:21,647 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:22,647 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:23,647 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:24,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:25,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:25,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:26,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:27,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:28,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:29,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:30,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:30,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:31,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:05:31,677 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:05:31,678 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:05:31,715 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:05:31,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:32,171 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:05:32,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:33,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:34,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:35,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:35,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:35,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:05:35,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:05:36,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:37,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:38,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:39,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:40,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:41,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:41,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:42,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:43,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:44,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:45,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:46,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:46,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:48,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:49,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:50,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:50,383 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:05:50,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:05:50,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:05:51,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:05:51,082 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:05:51,082 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:05:51,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:51,138 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:05:51,600 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:05:52,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:52,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:53,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:54,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:55,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:56,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:57,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:57,110 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:05:58,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:05:59,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:00,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:01,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:02,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:03,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:03,110 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:04,134 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:05,134 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:05,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:06:05,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:06:06,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:07,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:08,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:08,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:09,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:09,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:06:09,388 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:06:09,388 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:06:09,423 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:06:09,991 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:06:10,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:11,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:12,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:13,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:14,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:14,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:15,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:16,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:17,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:18,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:19,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:19,661 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:20,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:20,384 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:06:20,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:06:20,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:06:21,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:22,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:23,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:24,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:24,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:25,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:26,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:27,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:27,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:06:27,705 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:06:27,706 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:06:27,748 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:06:28,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:28,415 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:06:29,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:30,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:30,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:31,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:32,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:33,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:34,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:35,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:35,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:06:35,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:06:36,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:36,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:37,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:38,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:39,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:40,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:41,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:41,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:42,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:43,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:44,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:45,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:45,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:06:45,489 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:06:45,490 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:06:45,532 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:06:45,801 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:06:46,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:47,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:47,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:48,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:49,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:50,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:50,385 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:06:50,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:06:50,992 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:06:51,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:52,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:52,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:53,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:54,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:55,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:56,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:57,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:57,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:06:58,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:06:59,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:00,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:01,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:02,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:03,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:03,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:04,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:07:04,037 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:07:04,037 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:07:04,077 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:07:04,231 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:07:04,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:05,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:05,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:07:05,992 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:07:06,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:07,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:08,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:08,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:09,462 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:10,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:11,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:12,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:13,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:14,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:14,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:15,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:16,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:17,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:18,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:19,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:19,799 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:20,386 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:07:20,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:20,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:07:20,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:07:21,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:22,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:07:22,201 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:07:22,202 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:07:22,235 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:07:22,693 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:07:22,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:23,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:24,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:25,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:25,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:26,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:27,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:28,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:29,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:30,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:30,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:31,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:32,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:33,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:34,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:35,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:35,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:07:35,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:07:36,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:36,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:37,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:38,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:39,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:40,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:07:40,497 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:07:40,498 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:07:40,638 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:07:40,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:41,198 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:07:41,639 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:41,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:42,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:43,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:44,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:45,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:46,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:46,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:48,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:49,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:50,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:50,387 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:07:50,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:07:50,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:07:51,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:52,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:52,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:53,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:54,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:55,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:56,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:57,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:57,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:07:58,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:58,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:07:58,962 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:07:58,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:07:58,993 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:07:59,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:07:59,568 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:08:00,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:01,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:02,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:02,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:03,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:04,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:05,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:05,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:08:05,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:08:06,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:07,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:07,328 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:08,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:09,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:10,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:11,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:12,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:12,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:13,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:14,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:15,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:16,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:17,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:17,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:18,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:19,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:20,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:20,389 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:08:20,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:08:20,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:08:21,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:22,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:22,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:23,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:24,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:25,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:26,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:27,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:27,657 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:28,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:29,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:30,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:31,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:32,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:32,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:33,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:34,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:35,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:35,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:08:35,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:08:36,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:37,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:37,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:38,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:39,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:40,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:41,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:42,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:42,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:43,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:44,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:45,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:46,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:47,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:47,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:48,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:49,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:49,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:08:49,405 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:08:49,405 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:08:49,453 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:08:49,742 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:08:50,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:50,390 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:08:50,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:08:50,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:08:51,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:52,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:53,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:53,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:54,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:55,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:56,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:57,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:58,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:08:58,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:08:59,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:00,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:01,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:02,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:03,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:03,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:04,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:05,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:05,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:09:05,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:09:06,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:07,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:08,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:09:08,085 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:09:08,086 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:09:08,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:08,120 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:09:08,177 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:09:09,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:09,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:10,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:11,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:12,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:13,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:14,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:14,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:15,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:16,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:17,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:18,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:19,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:19,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:20,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:20,391 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:09:20,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:09:20,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:09:21,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:22,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:23,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:24,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:25,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:25,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:09:25,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:25,142 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:09:25,142 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:09:25,211 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:09:25,538 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:09:26,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:27,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:28,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:29,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:30,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:30,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:31,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:32,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:33,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:34,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:35,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:35,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:09:35,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:09:36,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:36,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:37,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:38,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:39,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:40,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:41,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:41,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:42,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:43,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:09:43,046 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:09:43,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:09:43,110 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:43,120 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:09:43,947 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:09:44,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:45,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:46,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:46,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:47,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:48,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:49,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:50,392 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:09:50,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:50,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:09:50,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:09:51,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:51,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:52,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:53,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:54,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:55,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:56,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:57,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:09:57,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:58,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:09:59,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:00,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:10:00,890 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:10:00,890 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:10:00,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:00,947 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:10:01,356 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:10:01,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:02,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:02,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:03,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:04,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:05,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:05,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:10:05,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:10:06,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:07,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:07,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:08,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:09,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:10,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:11,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:12,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:12,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:13,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:14,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:15,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:16,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:17,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:18,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:18,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:19,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:20,393 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:10:20,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:10:20,741 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:10:20,742 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:10:20,784 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:10:20,788 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:10:20,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:20,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:10:20,994 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:10:21,805 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:10:21,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:22,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:23,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:23,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:24,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:25,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:26,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:28,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:28,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:29,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:30,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:31,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:32,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:33,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:34,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:34,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:35,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:36,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:36,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:10:36,364 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:10:37,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:38,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:39,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:39,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:39,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:10:39,777 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:10:39,778 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:10:39,824 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:10:40,234 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:10:40,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:41,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:42,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:43,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:44,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:44,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:45,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:46,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:47,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:48,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:49,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:49,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:50,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:50,395 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:10:51,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:10:51,364 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:10:51,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:52,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:53,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:54,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:55,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:55,480 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:10:56,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:57,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:58,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:10:59,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:00,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:11:00,222 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:11:00,222 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:11:00,256 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:11:00,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:00,713 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:11:01,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:01,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:02,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:03,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:04,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:05,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:06,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:11:06,365 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:11:06,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:06,452 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:07,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:08,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:09,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:10,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:11,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:11,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:12,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:13,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:14,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:15,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:16,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:17,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:17,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:18,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:19,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:19,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:11:19,937 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:11:19,938 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:11:19,972 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:11:20,261 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:11:20,396 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:11:20,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:21,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:11:21,369 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:11:21,550 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:22,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:22,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:23,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:24,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:25,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:26,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:27,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:27,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:28,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:29,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:30,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:31,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:32,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:32,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:33,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:34,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:35,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:36,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:11:36,369 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:11:36,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:37,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:37,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:37,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:11:37,957 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:11:37,957 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:11:38,053 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:11:38,725 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:11:38,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:39,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:40,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:41,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:42,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:43,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:43,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:44,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:45,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:46,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:47,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:48,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:48,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:49,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:50,397 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:11:50,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:51,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:11:51,369 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:11:51,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:52,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:53,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:53,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:54,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:55,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:56,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:57,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:11:57,437 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:11:57,438 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:11:57,503 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:11:57,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:58,136 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:11:58,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:11:58,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:11:59,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:00,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:01,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:02,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:03,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:03,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:04,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:05,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:06,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:12:06,369 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:12:06,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:07,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:08,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:08,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:09,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:10,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:11,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:12,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:13,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:13,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:14,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:15,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:16,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:17,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:18,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:18,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:19,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:20,399 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:12:20,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:21,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:12:21,369 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:12:21,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:22,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:23,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:24,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:24,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:25,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:26,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:27,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:28,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:29,307 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:29,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:30,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:31,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:32,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:33,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:34,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:34,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:35,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:36,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:12:36,370 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:12:36,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:37,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:38,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:39,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:39,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:40,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:41,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:42,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:43,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:44,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:44,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:45,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:46,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:47,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:12:47,190 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:12:47,190 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:12:47,244 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:12:47,257 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:12:47,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:48,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:49,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:49,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:50,400 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:12:50,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:51,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:12:51,370 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:12:51,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:52,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:54,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:55,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:55,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:12:56,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:57,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:58,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:12:59,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:00,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:00,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:01,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:02,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:03,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:04,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:05,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:06,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:06,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:06,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:13:06,371 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:13:06,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:13:06,856 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:13:06,857 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:13:06,892 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:13:07,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:07,691 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:13:08,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:09,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:10,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:11,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:11,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:12,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:13,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:14,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:15,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:16,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:16,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:17,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:18,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:19,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:20,408 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:13:20,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:21,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:13:21,370 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:13:21,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:22,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:22,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:23,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:24,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:25,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:26,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:26,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:13:26,562 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:13:26,562 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:13:26,631 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:13:27,106 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:13:27,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:28,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:28,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:29,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:30,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:31,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:32,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:33,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:34,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:34,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:35,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:36,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:13:36,371 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:13:36,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:37,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:38,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:39,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:39,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:40,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:41,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:42,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:43,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:44,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:44,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:44,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:13:44,878 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:13:44,878 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:13:44,931 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:13:45,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:45,587 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:13:46,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:47,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:48,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:49,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:49,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:50,402 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:13:50,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:51,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:13:51,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:13:51,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:52,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:53,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:54,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:55,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:13:55,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:56,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:57,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:58,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:13:59,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:00,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:00,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:01,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:02,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:03,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:04,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:14:04,514 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:14:04,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:14:04,545 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:14:04,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:05,030 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:14:05,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:06,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:06,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:14:06,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:14:06,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:07,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:08,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:09,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:10,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:11,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:11,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:12,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:13,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:14,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:15,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:16,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:17,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:17,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:18,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:19,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:20,404 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:14:20,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:21,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:14:21,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:14:21,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:22,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:22,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:14:22,845 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:14:22,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:14:22,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:22,878 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:14:23,498 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:14:23,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:24,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:25,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:26,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:27,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:27,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:28,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:29,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:30,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:31,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:32,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:32,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:34,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:35,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:36,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:36,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:14:36,575 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:14:37,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:37,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:38,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:39,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:40,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:41,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:42,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:42,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:14:42,302 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:14:42,303 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:14:42,366 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:14:42,982 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:14:43,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:43,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:44,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:45,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:46,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:47,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:48,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:48,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:49,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:50,038 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:50,405 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:14:51,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:51,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:14:51,575 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:14:52,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:53,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:54,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:54,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:14:55,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:56,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:57,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:58,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:59,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:14:59,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:00,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:00,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:15:00,713 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:15:00,714 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:15:00,761 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:15:01,396 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:15:01,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:02,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:03,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:04,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:05,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:05,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:06,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:06,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:15:06,575 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:15:07,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:08,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:09,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:10,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:10,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:11,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:12,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:13,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:14,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:15,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:15,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:16,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:17,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:18,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:19,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:20,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:15:20,161 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:15:20,162 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:15:20,217 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:15:20,414 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:15:20,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:20,837 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:15:21,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:21,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:21,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:15:21,575 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:15:22,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:23,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:24,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:25,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:26,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:26,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:27,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:28,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:29,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:30,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:31,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:32,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:32,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:33,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:34,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:35,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:36,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:36,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:15:36,575 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:15:37,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:37,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:38,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:39,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:39,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:15:39,662 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:15:39,662 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:15:39,712 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:15:40,383 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:15:40,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:41,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:42,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:42,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:43,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:44,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:45,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:46,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:47,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:48,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:48,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:49,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:50,408 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:15:50,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:51,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:15:51,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:15:51,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:52,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:53,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:53,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:54,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:55,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:56,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:57,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:58,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:15:58,430 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:15:58,430 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:15:58,461 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:15:58,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:15:58,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:15:58,773 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:15:59,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:00,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:01,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:02,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:03,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:03,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:04,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:05,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:06,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:16:06,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:16:06,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:07,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:08,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:08,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:09,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:10,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:11,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:12,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:13,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:13,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:14,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:15,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:16,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:17,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:18,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:18,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:19,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:20,409 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:16:20,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:21,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:16:21,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:16:21,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:22,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:23,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:23,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:24,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:25,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:26,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:27,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:28,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:29,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:29,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:30,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:31,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:32,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:33,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:34,180 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:34,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:35,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:36,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:16:36,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:16:36,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:37,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:38,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:39,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:39,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:40,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:41,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:42,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:43,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:44,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:44,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:45,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:46,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:47,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:48,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:48,642 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:16:48,643 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:16:48,644 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:16:48,714 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:16:48,926 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:16:49,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:49,715 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:50,411 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:16:50,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:51,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:16:51,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:16:51,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:52,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:53,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:54,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:55,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:16:55,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:56,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:57,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:58,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:16:59,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:00,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:00,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:01,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:02,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:03,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:04,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:05,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:06,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:06,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:17:06,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:17:07,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:08,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:17:08,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:08,210 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:17:08,211 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:17:08,278 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:17:08,387 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:17:09,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:10,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:10,609 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:11,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:12,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:13,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:14,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:15,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:16,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:16,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:17,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:18,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:19,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:20,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:20,412 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:17:21,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:21,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:17:21,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:17:21,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:22,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:23,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:24,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:25,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:26,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:27,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:27,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:27,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:17:27,293 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:17:27,293 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:17:27,361 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:17:27,779 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:17:28,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:29,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:30,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:31,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:32,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:32,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:33,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:34,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:35,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:36,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:36,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:17:36,604 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:17:37,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:38,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:38,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:39,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:40,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:41,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:42,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:43,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:43,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:44,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:45,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:45,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:17:45,793 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:17:45,794 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:17:45,835 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:17:46,219 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:17:46,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:47,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:48,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:48,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:49,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:50,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:50,413 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:17:51,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:51,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:17:51,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:17:52,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:53,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:54,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:54,419 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:17:55,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:56,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:57,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:58,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:17:59,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:00,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:00,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:01,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:02,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:03,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:04,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:18:04,393 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:18:04,394 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:18:04,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:04,442 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:18:04,677 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:18:05,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:05,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:06,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:18:06,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:18:06,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:07,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:08,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:09,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:10,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:10,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:11,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:12,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:13,609 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:14,609 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:15,609 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:15,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:16,609 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:17,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:18,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:19,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:20,415 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:18:20,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:21,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:21,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:18:21,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:18:21,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:22,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:18:22,293 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:18:22,293 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:18:22,342 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:18:22,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:23,111 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:18:23,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:24,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:25,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:26,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:27,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:27,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:28,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:29,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:30,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:31,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:32,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:32,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:33,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:34,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:35,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:36,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:18:36,578 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:18:36,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:37,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:37,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:38,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:39,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:40,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:41,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:18:41,362 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:18:41,362 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:18:41,424 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:18:41,553 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:18:41,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:42,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:43,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:43,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:44,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:45,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:46,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:47,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:48,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:49,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:49,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:50,416 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:18:50,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:51,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:18:51,578 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:18:51,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:52,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:53,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:54,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:54,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:18:55,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:56,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:57,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:58,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:18:59,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:18:59,153 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:18:59,154 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:18:59,197 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:18:59,955 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:18:59,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:00,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:00,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:01,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:02,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:03,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:04,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:05,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:05,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:06,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:19:06,578 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:19:06,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:07,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:08,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:09,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:10,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:10,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:11,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:12,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:13,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:14,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:15,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:16,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:16,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:17,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:18,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:19:18,769 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:19:18,770 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:19:18,805 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:19:18,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:19,455 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:19:19,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:20,417 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:19:20,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:21,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:19:21,578 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:19:21,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:21,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:22,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:23,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:24,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:25,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:26,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:27,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:27,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:28,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:29,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:30,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:31,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:32,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:32,972 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:33,972 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:34,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:35,972 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:36,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:19:36,578 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:19:36,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:37,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:19:37,710 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:19:37,710 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:19:37,757 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:19:37,891 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:19:37,971 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:37,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:38,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:39,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:40,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:41,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:42,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:42,975 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:44,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:45,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:46,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:47,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:48,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:48,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:49,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:50,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:50,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:19:51,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:51,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:19:51,579 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:19:52,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:53,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:54,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:54,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:55,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:56,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:57,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:19:57,134 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:19:57,134 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:19:57,169 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:19:57,306 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:19:57,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:58,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:19:59,317 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:19:59,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:00,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:01,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:02,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:03,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:04,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:04,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:05,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:06,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:06,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:20:06,579 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:20:07,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:08,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:09,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:09,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:10,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:11,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:12,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:13,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:14,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:14,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:15,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:16,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:17,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:18,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:19,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:19,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:20,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:20,420 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:20:21,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:21,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:20:21,579 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:20:22,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:23,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:24,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:24,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:25,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:26,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:27,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:28,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:29,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:29,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:30,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:31,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:32,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:33,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:34,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:34,982 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:35,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:36,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:36,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:20:36,579 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:20:37,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:38,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:39,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:40,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:40,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:41,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:42,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:43,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:44,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:45,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:45,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:46,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:47,116 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:20:47,118 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:20:47,118 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:20:47,171 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:20:47,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:47,469 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:20:48,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:49,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:50,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:50,421 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:20:50,422 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:51,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:51,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:20:51,579 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:20:52,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:53,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:54,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:55,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:55,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:20:56,418 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:57,418 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:58,418 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:20:59,418 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:00,419 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:00,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:01,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:02,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:03,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:04,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:05,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:21:05,386 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:21:05,386 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:21:05,431 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:21:05,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:05,939 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:21:06,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:06,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:06,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:21:06,580 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:21:07,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:08,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:09,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:10,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:11,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:11,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:12,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:13,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:14,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:15,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:16,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:17,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:17,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:18,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:19,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:20,422 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:21:20,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:21,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:21,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:21:21,580 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:21:22,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:22,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:23,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:24,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:24,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:21:24,761 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:21:24,762 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:21:24,809 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:21:25,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:25,478 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:21:26,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:27,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:27,716 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:28,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:29,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:30,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:31,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:32,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:32,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:33,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:34,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:35,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:36,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:21:36,580 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:21:36,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:37,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:38,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:38,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:39,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:40,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:41,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:42,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:21:42,555 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:21:42,555 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:21:42,589 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:21:42,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:42,982 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:21:43,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:43,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:44,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:45,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:46,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:47,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:48,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:48,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:49,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:50,423 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:21:50,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:51,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:21:51,580 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:21:51,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:52,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:53,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:53,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:54,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:55,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:56,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:57,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:58,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:21:58,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:21:59,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:00,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:01,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:22:01,165 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:22:01,166 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:22:01,199 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:22:01,493 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:22:01,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:02,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:03,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:04,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:04,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:05,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:06,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:22:06,581 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:22:06,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:07,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:08,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:09,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:09,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:10,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:11,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:12,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:13,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:14,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:14,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:15,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:16,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:17,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:18,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:19,594 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:19,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:20,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:22:20,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:21,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:22:21,538 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:22:21,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:22:21,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:22:21,588 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:22:21,589 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:22:21,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:22,030 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:22:22,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:23,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:24,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:25,330 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:25,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:26,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:27,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:28,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:29,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:30,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:31,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:31,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:32,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:33,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:34,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:35,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:36,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:36,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:22:36,581 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:22:36,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:37,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:38,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:39,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:40,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:22:40,689 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:22:40,690 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:22:40,740 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:22:40,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:41,491 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:22:41,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:41,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:42,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:43,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:44,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:45,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:46,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:47,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:48,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:49,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:50,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:50,426 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:22:51,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:51,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:22:51,581 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:22:52,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:52,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:53,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:54,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:55,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:56,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:57,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:57,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:22:58,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:22:59,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:00,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:00,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:23:00,493 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:23:00,494 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:23:00,555 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:23:00,922 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:23:01,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:02,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:03,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:03,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:04,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:05,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:06,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:06,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:23:06,581 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:23:07,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:08,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:09,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:09,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:10,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:11,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:12,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:13,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:14,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:14,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:15,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:16,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:17,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:18,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:19,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:23:19,034 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:23:19,034 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:23:19,068 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:23:19,362 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:23:19,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:20,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:20,427 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:23:20,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:21,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:21,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:23:21,581 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:23:22,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:23,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:24,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:25,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:25,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:26,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:27,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:28,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:29,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:30,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:31,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:31,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:32,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:33,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:34,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:35,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:36,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:23:36,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:23:36,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:36,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:37,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:23:37,409 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:23:37,410 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:23:37,469 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:23:37,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:37,768 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:23:38,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:39,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:40,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:41,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:41,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:42,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:43,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:44,759 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:45,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:46,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:47,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:47,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:48,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:49,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:50,428 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:23:50,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:51,581 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:23:51,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:23:51,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:52,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:52,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:53,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:54,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:55,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:23:55,262 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:23:55,262 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:23:55,301 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:23:55,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:56,197 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:23:56,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:57,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:58,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:23:58,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:23:59,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:00,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:01,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:02,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:03,041 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:03,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:04,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:05,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:06,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:24:06,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:24:06,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:07,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:08,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:08,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:09,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:10,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:11,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:12,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:13,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:13,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:14,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:15,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:16,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:17,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:18,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:18,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:19,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:20,430 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:24:20,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:21,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:24:21,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:24:21,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:22,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:23,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:23,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:24,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:25,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:26,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:27,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:28,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:28,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:29,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:30,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:31,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:32,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:33,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:33,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:34,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:35,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:36,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:24:36,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:24:36,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:37,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:38,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:38,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:39,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:40,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:41,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:42,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:43,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:43,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:44,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:45,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:24:45,598 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:24:45,598 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:24:45,633 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:24:45,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:46,358 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:24:46,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:47,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:48,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:49,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:50,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:50,431 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:24:51,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:51,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:24:51,620 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:24:52,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:53,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:54,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:54,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:24:55,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:56,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:57,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:58,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:24:59,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:00,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:00,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:01,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:02,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:03,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:04,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:05,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:05,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:25:05,122 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:25:05,122 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:25:05,158 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:25:05,743 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:25:06,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:06,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:06,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:25:06,585 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:25:07,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:08,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:09,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:10,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:11,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:11,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:12,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:13,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:14,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:15,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:16,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:17,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:17,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:18,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:19,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:20,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:20,432 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:25:21,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:21,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:25:21,584 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:25:22,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:22,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:23,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:23,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:25:23,526 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:25:23,526 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:25:23,568 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:25:24,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:24,214 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:25:25,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:26,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:27,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:28,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:28,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:29,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:30,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:31,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:32,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:33,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:33,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:34,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:35,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:36,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:36,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:25:36,585 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:25:37,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:38,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:39,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:39,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:40,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:41,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:42,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:43,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:43,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:25:43,778 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:25:43,778 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:25:43,828 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:25:44,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:44,749 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:25:44,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:45,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:46,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:47,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:48,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:49,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:50,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:50,433 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:25:50,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:51,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:51,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:25:51,585 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:25:52,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:53,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:54,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:55,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:56,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:25:56,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:57,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:58,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:25:59,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:00,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:01,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:01,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:02,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:02,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:26:02,978 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:26:02,978 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:26:03,023 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:26:03,080 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:26:03,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:04,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:05,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:06,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:06,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:26:06,585 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:26:06,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:07,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:08,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:09,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:10,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:11,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:11,799 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:12,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:13,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:14,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:15,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:16,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:16,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:17,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:18,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:19,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:20,435 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:26:20,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:21,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:26:21,585 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:26:21,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:22,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:22,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:23,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:26:23,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:23,786 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:26:23,786 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:26:23,830 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:26:24,540 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:26:24,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:25,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:26,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:27,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:28,357 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:28,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:29,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:30,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:31,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:32,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:33,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:33,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:34,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:35,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:36,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:26:36,586 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:26:36,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:37,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:38,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:38,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:39,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:40,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:41,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:42,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:43,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:26:43,254 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:26:43,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:26:43,311 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:26:43,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:43,999 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:26:44,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:44,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:45,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:46,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:47,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:48,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:49,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:50,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:50,437 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:26:50,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:51,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:26:51,586 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:26:51,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:52,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:53,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:54,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:55,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:26:55,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:56,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:57,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:58,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:26:59,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:00,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:00,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:01,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:02,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:27:02,270 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:27:02,270 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:27:02,322 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:27:02,372 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:27:02,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:03,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:04,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:05,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:05,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:06,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:27:06,586 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:27:06,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:07,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:08,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:09,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:10,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:11,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:11,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:12,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:13,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:14,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:15,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:16,761 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:16,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:17,988 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:18,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:19,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:20,438 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:27:20,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:21,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:27:21,720 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:27:21,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:21,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:22,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:27:22,194 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:27:22,194 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:27:22,236 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:27:22,909 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:27:22,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:23,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:24,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:25,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:26,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:27,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:27,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:28,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:29,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:30,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:31,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:32,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:32,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:33,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:34,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:35,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:36,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:27:36,720 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:27:36,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:37,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:38,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:38,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:39,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:40,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:41,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:27:41,229 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:27:41,230 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:27:41,293 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:27:41,305 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:27:41,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:42,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:43,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:43,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:44,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:45,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:46,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:47,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:48,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:49,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:49,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:50,439 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:27:51,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:51,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:27:51,721 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:27:52,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:53,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:53,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:54,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:55,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:56,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:57,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:58,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:59,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:27:59,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:27:59,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:27:59,698 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:27:59,698 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:27:59,743 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:28:00,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:00,713 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:28:01,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:02,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:03,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:04,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:04,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:05,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:06,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:06,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:28:06,721 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:28:07,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:08,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:09,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:09,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:10,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:11,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:12,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:13,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:14,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:14,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:15,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:16,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:17,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:18,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:19,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:20,003 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:20,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:20,441 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:28:21,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:21,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:28:21,721 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:28:22,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:23,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:24,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:25,091 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:25,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:26,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:27,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:28,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:29,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:30,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:30,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:31,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:32,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:33,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:34,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:35,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:35,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:36,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:36,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:28:36,721 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:28:37,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:38,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:39,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:40,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:40,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:41,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:42,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:43,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:44,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:45,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:45,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:46,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:47,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:48,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:49,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:49,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:28:49,412 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:28:49,413 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:28:49,444 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:28:49,937 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:28:50,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:50,442 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:28:51,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:51,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:51,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:28:51,721 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:28:52,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:53,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:54,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:55,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:56,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:56,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:28:57,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:58,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:28:59,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:00,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:01,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:02,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:02,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:03,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:04,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:05,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:06,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:06,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:29:06,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:29:07,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:07,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:08,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:08,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:29:08,509 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:29:08,510 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:29:08,558 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:29:09,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:09,441 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:29:10,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:11,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:12,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:13,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:13,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:14,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:15,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:16,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:17,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:18,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:18,643 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:19,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:20,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:20,444 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:29:21,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:21,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:29:21,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:29:22,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:23,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:23,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:24,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:25,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:26,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:27,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:28,308 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:29:28,309 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:28,310 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:29:28,310 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:29:28,349 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:29:28,922 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:29:29,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:29,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:30,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:31,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:32,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:33,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:34,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:34,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:35,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:36,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:36,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:29:36,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:29:37,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:38,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:39,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:40,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:40,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:41,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:42,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:43,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:44,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:45,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:45,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:46,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:46,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:29:46,985 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:29:46,986 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:29:47,023 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:29:47,368 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:29:47,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:48,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:49,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:50,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:50,445 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:29:50,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:51,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:51,722 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:29:51,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:29:52,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:53,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:54,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:55,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:55,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:29:56,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:57,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:58,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:29:59,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:00,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:01,357 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:01,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:02,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:03,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:04,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:05,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:06,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:06,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:30:06,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:30:06,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:06,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:30:06,996 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:30:06,996 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:30:07,057 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:30:07,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:07,849 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:30:08,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:09,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:10,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:11,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:11,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:12,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:13,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:14,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:15,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:16,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:17,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:17,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:18,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:19,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:20,446 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:30:20,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:21,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:21,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:30:21,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:30:22,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:22,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:23,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:24,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:25,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:30:25,349 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:30:25,350 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:30:25,418 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:30:25,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:26,279 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:30:26,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:27,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:28,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:28,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:29,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:30,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:31,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:32,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:33,654 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:33,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:34,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:35,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:36,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:36,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:30:36,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:30:37,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:38,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:38,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:39,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:40,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:41,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:43,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:43,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:44,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:44,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:30:44,254 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:30:44,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:30:44,286 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:30:44,686 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:30:45,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:46,317 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:47,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:48,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:49,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:49,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:50,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:50,448 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:30:51,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:51,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:30:51,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:30:52,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:53,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:54,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:55,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:30:55,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:56,386 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:57,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:58,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:30:59,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:00,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:00,725 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:01,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:02,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:02,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:31:02,921 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:31:02,922 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:31:02,969 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:31:03,138 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:31:03,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:04,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:05,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:06,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:06,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:06,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:31:06,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:31:07,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:08,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:09,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:10,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:11,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:12,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:12,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:13,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:14,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:15,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:16,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:17,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:17,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:18,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:19,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:20,449 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:31:20,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:20,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:31:20,957 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:31:20,958 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:31:21,043 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:31:21,525 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:31:21,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:31:21,839 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:31:21,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:22,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:22,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:23,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:24,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:25,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:26,902 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:27,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:27,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:28,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:29,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:30,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:31,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:32,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:33,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:33,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:34,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:35,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:36,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:31:36,839 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:31:36,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:37,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:38,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:38,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:39,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:40,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:31:40,669 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:31:40,670 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:31:40,715 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:31:40,979 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:31:41,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:42,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:43,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:44,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:44,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:45,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:46,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:47,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:48,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:49,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:50,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:50,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:50,450 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:31:51,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:51,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:31:51,839 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:31:52,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:53,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:54,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:55,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:31:55,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:56,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:57,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:58,283 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:59,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:31:59,218 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:31:59,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:31:59,277 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:31:59,283 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:31:59,429 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:32:00,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:00,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:01,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:02,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:03,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:04,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:05,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:05,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:06,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:06,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:32:06,839 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:32:07,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:08,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:09,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:10,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:10,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:11,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:12,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:13,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:14,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:15,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:15,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:16,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:17,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:18,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:19,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:20,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:20,357 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:20,451 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:32:21,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:21,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:32:21,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:32:22,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:23,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:24,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:25,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:25,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:26,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:27,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:28,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:29,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:30,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:30,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:31,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:32,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:33,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:34,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:35,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:35,597 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:36,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:36,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:32:36,839 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:32:37,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:38,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:39,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:40,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:40,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:41,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:42,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:43,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:44,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:45,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:45,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:46,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:47,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:48,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:49,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:32:49,236 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:32:49,237 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:32:49,284 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:32:49,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:49,604 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:32:50,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:50,453 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:32:50,993 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:51,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:51,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:32:51,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:32:52,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:53,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:54,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:55,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:56,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:56,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:32:57,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:58,302 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:32:59,302 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:00,302 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:01,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:02,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:02,483 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:03,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:04,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:05,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:06,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:06,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:33:06,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:33:07,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:08,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:08,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:08,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:33:08,757 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:33:08,758 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:33:08,816 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:33:08,997 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:33:09,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:10,320 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:11,320 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:12,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:13,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:13,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:14,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:15,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:16,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:17,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:18,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:19,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:19,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:20,321 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:20,454 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:33:21,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:21,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:33:21,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:33:22,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:23,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:24,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:24,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:25,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:26,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:27,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:28,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:33:28,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:28,442 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:33:28,442 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:33:28,486 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:33:29,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:29,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:29,477 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:33:30,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:31,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:32,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:33,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:34,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:34,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:35,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:36,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:36,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:33:36,841 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:33:37,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:38,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:39,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:40,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:40,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:41,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:42,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:43,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:44,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:45,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:45,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:46,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:47,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:48,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:33:48,361 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:33:48,362 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:33:48,424 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:33:48,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:48,926 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:33:49,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:50,456 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:33:50,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:50,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:51,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:51,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:33:51,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:33:52,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:53,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:54,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:55,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:56,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:33:56,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:57,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:58,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:33:59,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:00,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:01,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:01,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:02,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:03,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:04,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:05,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:06,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:34:06,165 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:34:06,166 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:34:06,221 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:34:06,340 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:34:06,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:06,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:34:06,841 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:34:06,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:07,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:08,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:09,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:10,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:11,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:12,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:12,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:13,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:14,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:15,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:16,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:17,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:18,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:18,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:19,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:20,464 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:34:20,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:21,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:21,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:34:21,841 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:34:22,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:23,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:24,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:24,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:25,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:25,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:34:25,981 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:34:25,982 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:34:26,012 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:34:26,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:26,766 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:34:27,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:28,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:29,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:29,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:30,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:31,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:32,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:33,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:34,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:34,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:35,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:36,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:36,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:34:36,841 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:34:37,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:38,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:39,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:39,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:40,630 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:41,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:42,631 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:43,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:43,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:34:43,898 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:34:43,898 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:34:43,942 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:34:44,092 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:34:44,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:45,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:45,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:46,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:47,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:48,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:49,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:50,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:50,458 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:34:50,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:51,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:34:51,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:34:51,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:52,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:53,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:54,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:55,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:55,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:34:56,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:57,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:58,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:34:59,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:00,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:01,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:01,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:01,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:35:01,969 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:35:01,970 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:35:02,025 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:35:02,581 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:35:02,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:03,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:04,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:05,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:06,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:06,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:35:06,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:35:06,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:07,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:08,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:09,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:10,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:11,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:11,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:12,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:13,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:14,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:15,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:16,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:17,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:17,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:18,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:19,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:20,460 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:35:20,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:21,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:35:21,473 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:35:21,474 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:35:21,542 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:35:21,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:35:21,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:35:21,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:22,002 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:35:22,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:22,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:23,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:24,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:25,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:26,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:27,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:28,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:28,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:29,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:30,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:31,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:32,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:33,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:34,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:34,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:35,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:36,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:35:36,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:35:36,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:37,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:38,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:39,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:39,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:40,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:41,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:35:41,546 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:35:41,546 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:35:41,604 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:35:41,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:42,438 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:35:42,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:43,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:44,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:44,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:45,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:46,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:47,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:48,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:49,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:49,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:50,461 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:35:50,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:51,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:35:51,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:35:51,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:52,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:53,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:54,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:54,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:55,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:56,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:57,891 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:58,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:59,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:35:59,086 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:35:59,086 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:35:59,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:35:59,147 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:35:59,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:35:59,903 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:36:00,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:01,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:02,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:03,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:04,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:04,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:05,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:06,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:36:06,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:36:06,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:07,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:08,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:09,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:09,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:10,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:11,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:12,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:13,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:14,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:14,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:15,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:16,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:17,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:18,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:19,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:19,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:20,463 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:36:20,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:21,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:36:21,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:36:21,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:22,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:23,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:24,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:24,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:25,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:26,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:27,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:28,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:29,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:29,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:30,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:31,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:32,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:33,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:34,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:34,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:35,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:36,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:36:36,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:36:36,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:37,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:38,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:39,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:39,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:40,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:41,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:42,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:43,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:44,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:44,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:45,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:46,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:47,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:48,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:36:48,619 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:36:48,619 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:36:48,685 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:36:48,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:48,953 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:36:49,900 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:50,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:50,470 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:36:50,900 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:51,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:36:51,843 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:36:51,900 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:52,901 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:53,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:54,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:55,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:36:55,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:56,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:57,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:36:58,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:00,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:01,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:01,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:02,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:03,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:04,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:05,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:06,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:06,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:37:06,843 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:37:06,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:07,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:07,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:37:07,278 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:37:07,278 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:37:07,318 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:37:07,358 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:37:08,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:09,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:10,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:11,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:12,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:12,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:13,006 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:14,006 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:15,006 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:16,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:17,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:17,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:18,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:19,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:20,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:20,465 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:37:21,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:21,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:37:21,843 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:37:22,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:22,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:23,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:24,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:25,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:26,030 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:26,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:37:26,589 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:37:26,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:37:26,648 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:37:26,791 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:37:27,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:28,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:28,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:29,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:30,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:31,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:32,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:33,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:33,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:34,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:35,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:36,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:36,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:37:36,843 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:37:37,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:38,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:39,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:39,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:40,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:41,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:42,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:43,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:44,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:44,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:45,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:46,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:46,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:37:46,390 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:37:46,390 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:37:46,423 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:37:47,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:47,228 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:37:48,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:49,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:49,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:50,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:50,467 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:37:51,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:51,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:37:51,861 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:37:52,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:53,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:54,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:54,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:55,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:56,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:57,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:58,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:37:59,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:37:59,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:00,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:01,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:02,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:03,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:04,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:04,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:04,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:38:04,365 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:38:04,366 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:38:04,413 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:38:04,632 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:38:05,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:06,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:06,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:38:06,844 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:38:07,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:08,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:09,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:09,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:10,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:11,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:12,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:13,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:14,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:14,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:15,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:16,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:17,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:18,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:19,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:20,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:20,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:20,468 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:38:21,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:21,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:38:21,844 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:38:22,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:23,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:38:23,325 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:38:23,326 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:38:23,381 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:38:23,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:24,209 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:38:24,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:25,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:25,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:26,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:27,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:28,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:29,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:30,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:30,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:31,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:32,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:33,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:34,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:35,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:36,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:36,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:36,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:38:36,844 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:38:37,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:38,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:39,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:40,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:40,900 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:38:40,901 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:38:40,902 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:38:40,954 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:38:41,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:41,648 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:38:41,955 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:42,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:43,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:44,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:45,459 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:46,459 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:47,119 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:47,459 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:48,459 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:49,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:50,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:50,476 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:38:51,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:51,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:38:51,844 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:38:52,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:52,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:53,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:54,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:55,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:56,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:57,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:58,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:38:58,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:38:59,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:00,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:39:00,121 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:39:00,122 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:39:00,163 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:39:00,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:01,033 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:39:01,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:02,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:03,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:03,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:04,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:05,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:06,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:06,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:39:06,845 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:39:07,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:08,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:09,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:09,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:10,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:11,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:12,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:13,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:14,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:14,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:15,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:16,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:17,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:18,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:19,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:19,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:39:19,729 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:39:19,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:39:19,788 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:39:19,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:20,461 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:39:20,471 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:39:20,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:21,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:21,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:39:21,844 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:39:22,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:23,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:24,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:24,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:25,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:26,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:27,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:28,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:29,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:30,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:30,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:31,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:32,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:33,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:34,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:35,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:35,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:36,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:36,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:39:36,845 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:39:36,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:39:36,979 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:39:36,979 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:39:37,016 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:39:37,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:37,838 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:39:38,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:39,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:40,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:41,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:41,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:42,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:43,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:44,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:45,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:46,282 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:46,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:47,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:48,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:50,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:50,472 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:39:51,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:51,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:51,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:39:51,881 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:39:52,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:53,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:54,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:55,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:55,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:39:55,726 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:39:55,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:39:55,798 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:39:56,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:56,230 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:39:56,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:39:57,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:58,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:39:59,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:00,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:01,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:01,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:02,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:03,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:04,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:05,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:06,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:06,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:06,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:40:06,881 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:40:07,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:08,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:09,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:10,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:11,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:11,761 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:12,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:13,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:14,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:15,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:16,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:16,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:17,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:18,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:19,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:20,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:20,473 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:40:21,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:21,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:21,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:40:21,881 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:40:22,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:23,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:24,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:25,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:26,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:27,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:27,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:28,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:29,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:30,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:31,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:32,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:32,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:33,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:34,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:35,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:36,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:36,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:40:36,881 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:40:37,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:37,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:38,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:39,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:40,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:41,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:42,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:42,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:43,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:44,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:45,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:45,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:40:45,591 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:40:45,591 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:40:45,652 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:40:46,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:46,310 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:40:47,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:47,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:48,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:49,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:50,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:50,474 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:40:51,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:51,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:40:51,882 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:40:52,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:52,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:53,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:54,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:55,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:56,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:57,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:58,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:40:58,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:40:59,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:00,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:01,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:02,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:03,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:03,308 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:04,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:04,316 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:41:04,317 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:41:04,318 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:41:04,348 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:41:04,696 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:41:05,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:06,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:06,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:41:06,882 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:41:07,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:08,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:08,531 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:09,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:10,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:11,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:12,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:13,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:13,987 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:14,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:15,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:16,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:17,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:18,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:19,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:19,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:20,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:20,482 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:41:21,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:21,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:41:21,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:41:22,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:23,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:41:23,173 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:41:23,173 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:41:23,233 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:41:23,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:24,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:24,100 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:41:24,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:25,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:26,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:27,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:28,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:29,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:30,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:30,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:31,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:32,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:33,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:34,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:35,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:35,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:36,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:36,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:41:36,882 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:41:37,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:38,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:39,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:40,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:41,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:41,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:41,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:41:41,765 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:41:41,765 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:41:41,819 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:41:42,446 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:41:42,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:43,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:44,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:45,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:46,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:46,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:47,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:48,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:49,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:50,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:50,477 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:41:51,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:51,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:51,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:41:51,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:41:52,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:53,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:54,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:55,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:56,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:56,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:41:57,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:58,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:59,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:41:59,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:41:59,645 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:41:59,646 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:41:59,679 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:41:59,875 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:42:00,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:01,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:02,282 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:02,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:03,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:04,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:05,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:06,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:06,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:42:06,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:42:07,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:07,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:08,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:09,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:10,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:11,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:12,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:13,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:13,648 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:14,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:15,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:16,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:17,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:18,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:42:18,525 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:42:18,526 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:42:18,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:18,574 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:42:19,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:19,318 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:42:19,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:20,478 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:42:20,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:21,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:21,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:42:21,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:42:22,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:23,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:24,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:24,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:25,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:26,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:27,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:28,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:29,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:30,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:30,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:31,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:32,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:33,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:34,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:35,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:35,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:36,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:36,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:42:36,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:42:37,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:38,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:42:38,050 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:42:38,050 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:42:38,100 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:42:38,769 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:42:38,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:39,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:40,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:41,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:41,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:42,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:43,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:44,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:45,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:46,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:46,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:47,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:48,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:49,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:50,480 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:42:50,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:51,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:51,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:42:51,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:42:51,979 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:52,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:53,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:54,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:55,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:56,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:57,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:42:57,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:42:57,165 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:42:57,165 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:42:57,201 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:42:57,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:58,148 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:42:58,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:42:59,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:00,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:01,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:02,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:02,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:03,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:04,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:05,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:06,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:43:06,883 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:43:06,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:07,716 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:07,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:08,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:09,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:10,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:11,978 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:12,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:12,978 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:14,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:14,979 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:15,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:16,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:17,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:43:17,697 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:43:17,698 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:43:17,772 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:43:17,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:18,572 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:43:18,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:18,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:19,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:20,481 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:43:20,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:21,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:43:21,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:43:21,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:22,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:24,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:24,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:25,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:26,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:27,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:28,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:29,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:29,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:30,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:31,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:32,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:33,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:34,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:35,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:35,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:36,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:36,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:43:36,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:43:37,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:43:37,094 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:43:37,095 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:43:37,150 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:43:37,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:38,026 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:43:38,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:39,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:40,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:40,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:41,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:42,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:43,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:44,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:45,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:46,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:46,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:47,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:48,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:49,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:50,482 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:43:50,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:51,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:51,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:51,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:43:51,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:43:52,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:53,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:54,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:55,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:55,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:43:55,822 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:43:55,823 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:43:55,859 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:43:56,426 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:43:56,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:43:56,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:57,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:58,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:43:59,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:00,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:01,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:01,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:02,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:03,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:04,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:05,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:06,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:06,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:06,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:44:06,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:44:07,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:08,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:09,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:10,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:11,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:11,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:12,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:13,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:14,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:15,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:16,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:16,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:17,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:18,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:19,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:20,484 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:44:20,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:21,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:21,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:44:21,884 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:44:22,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:22,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:23,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:24,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:25,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:26,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:27,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:27,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:28,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:29,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:30,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:31,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:32,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:32,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:33,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:34,746 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:35,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:36,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:36,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:44:36,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:44:37,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:37,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:38,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:39,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:40,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:41,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:42,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:42,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:43,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:44,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:45,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:44:45,536 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:44:45,536 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:44:45,604 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:44:45,604 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:44:45,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:46,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:47,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:47,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:48,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:49,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:50,485 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:44:50,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:51,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:51,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:44:51,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:44:52,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:52,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:53,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:54,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:55,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:56,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:57,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:57,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:44:58,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:44:59,750 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:00,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:01,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:02,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:03,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:03,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:04,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:04,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:45:04,934 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:45:04,934 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:45:04,975 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:45:04,990 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:45:05,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:06,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:06,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:45:06,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:45:07,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:08,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:08,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:09,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:10,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:11,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:12,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:13,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:14,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:14,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:15,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:16,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:17,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:18,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:19,303 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:19,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:20,487 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:45:20,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:21,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:21,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:45:21,885 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:45:22,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:45:22,667 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:45:22,668 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:45:22,727 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:45:22,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:23,442 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:45:23,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:24,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:24,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:25,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:26,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:27,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:28,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:29,634 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:29,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:30,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:31,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:32,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:33,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:34,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:35,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:35,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:37,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:45:37,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:37,045 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:45:38,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:39,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:40,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:40,305 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:41,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:42,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:42,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:45:42,142 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:45:42,142 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:45:42,195 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:45:42,901 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:45:43,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:44,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:45,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:45,305 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:46,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:47,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:48,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:49,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:50,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:50,488 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:45:50,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:51,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:52,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:45:52,045 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:45:52,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:53,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:54,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:55,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:56,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:56,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:45:57,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:58,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:45:59,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:00,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:01,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:01,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:02,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:02,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:46:02,466 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:46:02,466 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:46:02,519 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:46:03,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:03,382 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:46:04,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:05,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:06,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:07,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:07,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:46:07,045 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:46:07,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:08,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:09,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:10,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:11,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:12,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:12,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:13,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:14,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:15,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:16,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:17,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:17,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:18,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:19,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:20,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:20,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:46:20,129 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:46:20,130 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:46:20,183 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:46:20,489 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:46:20,797 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:46:21,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:22,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:46:22,045 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:46:22,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:23,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:23,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:24,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:25,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:26,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:27,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:28,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:28,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:29,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:30,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:31,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:32,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:33,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:34,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:34,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:35,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:36,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:37,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:46:37,045 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:46:37,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:37,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:46:37,785 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:46:37,786 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:46:37,826 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:46:38,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:38,211 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:46:39,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:39,307 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:40,109 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:41,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:42,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:43,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:44,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:44,308 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:45,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:46,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:47,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:48,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:49,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:49,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:50,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:50,491 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:46:51,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:52,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:46:52,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:46:52,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:53,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:54,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:55,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:55,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:46:56,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:56,681 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:46:56,682 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:46:56,682 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:46:56,755 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:46:57,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:57,597 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:46:58,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:46:59,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:00,143 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:00,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:01,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:02,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:03,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:04,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:05,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:06,134 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:06,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:07,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:47:07,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:47:07,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:08,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:09,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:10,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:11,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:11,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:12,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:13,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:14,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:15,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:15,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:47:15,966 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:47:15,966 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:47:16,008 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:47:16,042 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:47:16,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:17,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:17,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:18,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:19,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:20,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:20,492 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:47:21,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:22,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:47:22,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:47:22,185 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:22,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:23,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:24,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:25,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:26,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:27,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:27,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:28,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:29,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:30,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:31,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:32,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:32,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:33,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:34,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:47:34,133 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:47:34,134 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:47:34,182 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:47:34,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:34,456 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:47:35,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:36,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:37,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:47:37,047 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:47:37,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:38,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:38,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:39,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:40,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:41,302 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:42,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:43,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:43,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:44,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:45,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:46,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:47,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:48,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:49,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:49,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:50,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:50,493 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:47:51,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:52,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:47:52,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:47:52,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:53,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:47:53,306 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:47:53,306 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:47:53,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:53,347 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:47:53,925 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:47:54,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:54,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:47:55,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:56,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:57,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:58,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:59,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:47:59,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:00,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:01,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:02,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:03,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:04,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:04,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:05,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:06,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:07,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:48:07,046 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:48:07,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:08,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:09,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:09,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:10,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:11,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:12,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:13,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:14,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:14,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:15,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:16,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:17,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:18,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:19,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:19,662 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:20,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:20,494 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:48:21,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:22,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:48:22,047 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:48:22,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:23,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:24,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:24,760 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:25,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:26,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:27,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:28,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:29,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:29,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:30,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:31,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:32,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:33,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:34,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:34,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:35,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:36,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:37,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:48:37,047 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:48:37,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:38,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:39,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:40,051 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:40,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:41,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:42,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:42,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:48:42,685 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:48:42,686 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:48:42,723 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:48:42,987 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:48:43,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:44,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:45,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:45,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:46,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:47,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:48,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:49,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:50,496 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:48:50,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:50,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:51,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:52,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:48:52,048 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:48:52,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:53,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:54,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:55,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:56,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:48:56,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:57,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:58,688 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:48:59,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:00,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:01,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:01,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:02,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:49:02,414 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:49:02,414 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:49:02,454 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:49:02,478 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:49:02,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:03,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:04,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:05,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:06,883 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:07,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:49:07,048 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:49:07,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:07,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:08,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:09,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:10,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:11,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:12,661 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:12,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:13,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:14,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:15,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:16,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:17,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:18,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:18,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:19,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:20,497 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:49:20,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:49:20,957 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:49:20,958 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:49:20,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:20,996 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:49:21,930 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:49:21,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:22,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:49:22,083 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:49:22,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:23,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:24,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:24,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:25,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:26,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:27,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:28,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:29,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:29,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:30,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:31,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:32,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:33,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:35,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:35,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:36,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:37,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:37,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:49:37,083 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:49:38,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:39,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:49:39,077 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:49:39,078 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:49:39,118 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:49:39,274 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:49:39,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:40,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:40,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:41,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:42,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:43,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:44,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:45,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:46,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:46,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:47,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:48,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:49,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:50,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:50,498 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:49:51,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:51,655 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:52,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:49:52,083 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:49:52,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:53,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:54,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:55,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:56,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:57,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:49:57,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:58,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:49:58,405 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:49:58,406 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:49:58,437 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:49:58,753 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:49:58,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:49:59,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:00,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:01,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:02,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:02,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:03,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:04,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:05,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:07,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:07,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:50:07,083 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:50:07,681 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:08,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:09,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:10,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:11,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:12,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:13,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:13,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:14,069 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:15,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:16,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:17,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:17,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:50:17,557 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:50:17,558 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:50:17,603 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:50:18,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:18,259 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:50:18,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:19,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:20,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:20,500 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:50:21,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:22,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:22,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:50:22,252 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:50:23,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:24,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:24,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:25,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:26,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:27,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:28,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:29,121 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:29,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:30,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:31,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:32,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:33,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:34,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:34,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:35,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:35,356 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:50:35,357 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:50:35,358 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:50:35,394 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:50:35,650 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:50:36,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:37,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:50:37,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:50:37,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:38,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:39,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:39,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:40,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:41,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:42,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:43,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:44,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:44,481 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:45,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:46,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:47,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:48,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:49,481 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:49,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:50,501 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:50:50,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:51,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:52,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:50:52,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:50:52,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:53,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:53,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:50:53,837 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:50:53,838 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:50:53,871 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:50:54,003 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:50:54,481 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:54,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:55,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:56,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:57,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:58,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:50:59,482 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:50:59,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:00,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:01,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:02,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:03,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:04,481 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:04,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:05,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:06,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:07,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:51:07,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:51:07,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:08,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:09,482 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:09,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:10,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:11,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:12,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:51:12,409 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:51:12,410 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:51:12,459 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:51:12,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:13,392 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:51:13,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:14,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:14,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:15,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:16,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:17,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:18,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:19,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:20,483 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:20,502 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:51:20,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:21,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:22,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:51:22,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:51:22,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:23,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:24,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:25,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:25,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:26,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:27,932 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:29,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:30,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:30,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:51:30,625 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:51:30,626 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:51:30,659 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:51:30,848 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:51:31,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:31,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:32,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:33,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:34,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:35,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:36,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:37,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:37,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:51:37,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:51:37,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:38,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:39,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:40,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:41,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:42,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:42,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:43,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:44,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:45,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:46,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:47,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:48,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:48,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:49,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:49,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:51:49,838 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:51:49,838 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:51:49,890 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:51:50,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:50,282 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:51:50,503 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:51:51,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:52,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:52,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:51:52,251 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:51:53,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:53,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:54,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:55,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:56,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:57,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:58,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:51:58,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:51:59,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:00,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:01,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:02,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:03,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:03,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:04,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:05,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:06,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:07,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:07,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:52:07,252 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:52:08,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:08,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:09,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:10,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:11,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:12,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:13,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:13,603 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:14,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:15,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:16,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:17,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:18,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:18,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:19,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:20,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:20,504 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:52:21,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:22,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:22,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:52:22,252 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:52:23,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:23,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:24,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:25,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:26,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:27,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:28,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:28,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:29,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:30,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:31,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:32,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:33,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:33,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:34,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:35,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:36,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:37,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:52:37,252 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:52:37,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:38,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:38,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:39,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:52:39,189 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:52:39,189 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:52:39,228 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:52:39,242 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:52:39,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:40,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:41,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:42,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:43,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:44,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:44,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:45,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:46,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:47,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:48,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:49,098 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:49,722 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:50,507 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:52:50,722 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:51,722 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:52,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:52:52,252 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:52:52,722 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:53,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:54,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:54,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:55,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:56,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:57,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:58,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:52:58,561 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:52:58,562 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:52:58,617 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:52:58,621 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:52:58,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:52:59,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:52:59,635 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:52:59,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:00,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:01,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:02,794 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:03,795 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:04,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:04,795 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:05,795 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:06,795 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:07,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:53:07,253 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:53:07,795 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:08,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:09,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:09,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:10,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:11,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:12,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:14,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:15,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:15,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:16,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:17,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:18,180 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:53:18,181 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:18,182 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:53:18,182 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:53:18,214 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:53:19,035 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:53:19,139 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:20,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:20,507 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:53:21,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:21,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:22,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:22,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:53:22,253 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:53:23,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:24,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:25,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:26,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:26,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:27,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:28,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:29,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:30,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:31,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:31,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:32,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:33,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:34,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:35,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:36,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:36,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:53:36,501 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:53:36,502 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:53:36,537 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:53:37,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:53:37,253 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:53:37,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:37,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:37,475 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:53:38,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:39,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:40,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:41,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:42,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:42,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:43,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:44,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:45,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:46,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:47,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:48,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:48,787 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:49,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:50,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:50,510 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:53:51,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:52,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:53:52,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:53:52,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:53,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:54,053 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:53:54,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:55,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:53:55,014 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:53:55,014 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:53:55,061 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:53:55,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:55,903 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:53:56,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:57,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:58,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:59,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:53:59,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:00,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:01,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:02,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:03,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:04,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:04,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:05,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:06,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:07,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:54:07,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:54:07,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:08,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:09,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:10,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:10,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:11,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:12,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:12,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:54:12,605 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:54:12,606 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:54:12,652 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:54:13,294 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:54:13,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:14,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:15,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:15,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:16,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:17,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:18,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:19,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:20,510 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:54:20,511 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:20,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:21,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:22,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:54:22,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:54:22,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:23,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:24,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:25,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:25,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:26,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:27,681 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:28,681 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:29,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:30,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:30,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:54:30,597 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:54:30,598 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:54:30,658 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:54:30,659 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:54:30,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:31,681 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:54:31,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:32,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:33,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:34,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:35,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:35,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:36,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:37,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:54:37,255 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:54:37,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:38,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:39,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:40,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:41,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:41,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:42,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:43,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:44,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:45,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:46,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:46,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:47,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:48,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:54:48,377 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:54:48,378 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:54:48,437 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:54:48,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:49,129 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:54:49,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:50,511 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:54:51,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:52,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:52,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:54:52,350 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:54:52,503 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:53,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:54,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:55,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:56,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:57,326 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:57,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:54:58,326 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:54:59,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:00,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:01,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:02,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:02,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:03,329 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:04,328 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:05,328 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:06,329 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:07,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:55:07,146 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:55:07,146 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:55:07,203 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:55:07,329 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:07,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:55:07,350 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:55:07,548 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:55:08,329 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:08,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:09,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:10,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:11,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:12,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:13,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:13,523 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:14,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:15,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:16,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:17,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:18,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:19,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:19,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:20,513 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:55:20,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:21,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:22,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:55:22,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:55:22,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:23,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:24,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:24,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:24,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:55:24,918 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:55:24,919 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:55:24,960 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:55:25,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:25,956 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:55:26,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:27,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:28,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:29,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:29,594 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:30,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:31,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:32,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:33,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:34,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:34,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:35,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:36,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:37,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:55:37,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:55:37,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:38,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:39,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:40,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:40,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:41,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:42,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:43,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:55:43,366 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:55:43,366 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:55:43,419 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:55:43,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:44,385 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:55:44,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:45,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:45,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:46,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:47,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:48,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:49,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:50,514 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:55:50,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:50,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:51,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:52,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:55:52,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:55:52,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:53,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:54,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:55,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:55,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:55:56,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:57,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:58,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:55:59,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:00,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:00,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:01,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:02,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:03,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:04,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:05,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:05,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:06,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:07,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:56:07,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:56:07,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:08,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:09,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:10,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:10,749 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:11,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:12,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:13,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:14,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:15,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:15,803 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:16,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:17,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:18,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:19,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:20,522 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:56:20,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:20,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:21,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:22,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:56:22,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:56:22,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:23,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:24,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:25,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:26,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:26,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:27,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:28,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:29,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:30,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:31,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:31,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:32,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:32,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:56:32,795 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:56:32,795 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:56:32,855 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:56:33,514 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:56:33,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:34,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:35,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:36,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:36,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:37,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:56:37,351 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:56:37,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:38,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:39,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:40,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:41,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:41,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:42,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:43,887 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:44,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:45,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:46,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:46,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:47,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:48,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:49,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:50,516 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:56:50,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:51,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:52,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:52,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:56:52,237 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:56:52,238 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:56:52,304 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:56:52,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:56:52,400 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:56:52,907 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:56:52,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:53,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:54,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:55,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:56,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:57,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:56:57,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:58,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:56:59,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:00,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:01,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:02,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:02,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:03,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:04,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:05,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:06,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:07,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:57:07,399 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:57:07,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:08,531 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:08,931 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:09,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:10,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:11,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:12,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:13,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:57:13,137 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:57:13,138 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:57:13,195 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:57:13,637 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:57:14,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:14,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:15,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:16,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:17,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:18,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:19,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:19,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:20,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:20,517 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:57:21,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:22,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:57:22,399 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:57:22,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:23,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:24,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:25,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:25,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:26,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:27,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:28,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:29,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:30,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:30,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:31,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:32,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:33,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:57:33,390 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:57:33,390 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:57:33,454 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:57:33,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:34,021 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:57:34,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:35,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:35,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:36,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:37,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:57:37,400 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:57:37,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:38,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:39,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:40,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:40,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:41,475 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:42,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:43,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:44,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:45,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:45,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:46,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:47,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:48,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:49,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:50,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:50,519 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:57:50,978 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:51,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:52,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:57:52,400 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:57:52,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:52,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:57:52,623 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:57:52,623 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:57:52,661 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:57:53,416 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:57:53,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:54,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:55,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:56,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:57:56,480 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:57,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:58,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:57:59,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:00,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:01,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:01,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:02,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:03,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:04,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:05,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:06,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:07,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:07,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:58:07,400 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:58:07,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:08,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:09,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:10,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:11,417 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:58:11,418 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:58:11,418 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:58:11,470 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:58:11,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:11,877 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:58:12,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:12,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:13,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:14,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:15,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:16,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:17,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:18,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:18,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:19,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:20,520 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:58:20,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:21,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:22,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:58:22,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:58:22,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:23,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:23,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:24,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:25,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:26,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:27,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:28,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:28,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:29,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:30,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:58:30,797 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:58:30,798 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:58:30,842 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:58:30,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:31,313 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:58:31,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:32,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:33,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:34,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:34,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:35,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:36,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:37,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:58:37,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:58:37,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:38,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:39,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:40,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:40,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:41,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:42,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:43,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:44,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:45,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:45,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:46,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:47,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:48,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:58:48,729 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:58:48,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:58:48,777 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:58:48,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:49,711 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:58:49,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:50,521 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:58:50,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:50,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:51,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:52,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:58:52,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:58:52,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:53,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:54,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:55,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:56,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:58:56,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:57,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:58,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:58:59,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:00,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:01,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:01,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:02,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:03,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:04,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:05,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:06,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:06,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:07,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:59:07,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:59:07,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:59:07,875 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:59:07,875 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:59:07,927 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:59:07,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:08,134 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:59:08,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:09,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:10,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:11,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:11,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:12,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:13,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:14,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:15,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:16,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:16,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:17,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:18,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:19,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:20,522 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:59:21,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:22,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:22,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:59:22,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:59:22,480 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:23,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:24,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:25,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:26,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:27,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:27,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:28,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:59:28,149 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:59:28,150 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:59:28,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:28,215 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:59:28,597 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:59:29,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:30,305 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:31,305 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:32,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:32,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:33,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:34,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:35,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:36,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:37,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:59:37,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:59:37,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:38,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:38,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:39,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:40,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:41,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:42,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:43,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:43,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:44,479 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:45,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:46,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 12:59:46,034 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 12:59:46,034 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 12:59:46,099 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 12:59:46,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:47,056 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 12:59:47,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:48,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:48,685 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:49,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:50,524 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 12:59:50,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:51,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:52,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 12:59:52,401 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 12:59:52,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:53,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:53,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:54,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:55,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:56,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:57,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:58,534 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 12:59:58,758 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 12:59:59,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:00,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:01,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:02,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:03,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:03,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:04,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:05,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:06,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:07,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:00:07,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:00:07,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:08,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:08,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:09,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:10,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:11,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:12,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:13,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:14,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:14,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:15,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:16,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:17,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:18,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:19,133 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:19,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:20,525 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:00:20,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:21,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:22,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:00:22,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:00:22,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:23,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:24,158 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:24,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:25,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:26,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:27,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:28,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:29,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:29,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:30,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:31,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:32,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:33,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:34,298 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:34,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:35,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:35,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:00:35,638 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:00:35,639 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:00:35,674 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:00:36,200 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:00:36,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:37,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:00:37,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:00:37,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:38,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:39,541 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:39,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:40,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:41,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:42,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:43,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:44,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:44,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:45,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:46,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:47,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:48,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:49,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:50,526 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:00:50,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:50,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:51,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:52,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:00:52,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:00:52,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:53,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:54,116 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:00:54,117 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:00:54,118 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:00:54,165 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:00:54,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:54,640 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:00:55,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:56,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:00:56,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:57,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:58,546 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:00:59,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:00,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:01,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:01,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:02,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:03,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:04,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:05,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:06,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:07,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:07,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:01:07,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:01:07,563 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:08,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:09,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:10,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:11,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:12,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:12,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:13,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:01:13,094 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:01:13,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:01:13,148 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:01:13,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:14,028 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:01:14,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:15,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:16,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:17,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:17,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:18,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:19,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:20,527 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:01:20,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:21,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:22,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:01:22,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:01:22,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:23,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:23,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:24,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:25,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:26,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:27,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:28,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:28,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:29,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:30,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:31,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:32,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:01:32,573 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:01:32,574 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:01:32,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:32,626 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:01:33,501 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:01:33,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:34,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:34,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:35,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:36,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:37,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:01:37,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:01:37,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:38,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:39,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:40,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:40,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:41,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:42,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:43,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:44,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:45,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:45,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:46,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:47,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:48,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:49,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:50,529 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:01:50,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:50,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:51,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:01:51,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:51,758 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:01:51,758 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:01:51,804 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:01:51,972 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:01:52,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:01:52,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:01:52,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:53,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:54,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:55,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:56,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:01:56,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:57,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:58,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:01:59,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:00,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:01,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:01,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:02,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:03,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:04,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:05,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:06,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:06,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:07,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:02:07,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:02:07,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:08,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:09,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:10,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:10,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:02:10,777 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:02:10,778 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:02:10,813 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:02:11,435 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:02:11,501 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:11,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:12,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:13,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:14,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:15,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:16,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:16,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:17,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:18,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:19,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:20,537 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:02:20,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:21,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:22,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:22,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:02:22,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:02:22,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:23,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:24,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:25,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:27,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:27,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:28,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:29,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:30,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:02:30,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:30,090 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:02:30,090 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:02:30,134 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:02:30,853 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:02:31,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:32,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:33,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:33,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:34,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:35,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:36,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:37,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:37,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:02:37,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:02:38,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:38,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:39,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:40,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:41,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:42,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:43,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:44,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:44,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:45,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:46,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:47,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:48,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:49,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:02:49,106 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:02:49,106 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:02:49,148 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:02:49,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:49,319 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:02:50,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:50,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:50,531 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:02:51,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:52,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:52,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:02:52,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:02:53,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:54,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:55,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:55,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:02:56,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:57,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:58,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:02:59,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:00,320 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:01,279 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:01,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:02,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:03,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:04,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:05,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:06,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:06,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:07,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:07,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:03:07,403 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:03:08,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:03:08,124 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:03:08,124 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:03:08,172 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:03:08,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:08,769 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:03:09,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:10,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:11,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:11,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:12,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:13,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:14,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:15,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:16,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:17,091 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:17,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:18,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:19,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:20,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:20,533 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:03:21,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:22,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:22,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:03:22,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:03:22,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:23,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:24,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:25,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:26,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:26,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:03:26,805 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:03:26,806 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:03:26,867 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:03:27,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:27,166 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:03:27,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:28,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:29,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:30,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:31,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:32,523 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:33,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:33,523 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:34,523 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:35,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:36,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:37,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:03:37,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:03:37,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:38,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:38,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:39,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:40,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:41,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:42,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:43,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:44,532 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:44,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:45,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:45,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:03:45,870 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:03:45,870 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:03:45,908 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:03:46,589 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:03:46,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:47,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:48,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:49,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:49,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:50,534 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:03:50,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:51,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:52,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:03:52,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:03:52,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:53,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:54,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:54,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:03:55,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:56,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:57,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:58,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:59,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:03:59,777 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:00,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:01,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:02,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:03,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:04,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:04,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:05,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:06,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:07,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:04:07,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:04:07,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:08,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:09,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:09,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:10,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:11,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:12,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:13,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:14,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:14,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:15,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:16,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:17,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:18,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:19,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:19,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:20,535 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:04:20,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:21,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:22,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:04:22,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:04:22,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:23,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:24,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:24,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:25,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:26,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:27,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:28,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:29,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:29,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:30,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:31,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:32,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:33,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:34,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:34,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:04:34,865 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:04:34,865 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:04:34,922 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:04:35,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:35,674 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:04:35,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:36,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:37,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:04:37,523 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:04:38,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:39,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:40,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:41,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:41,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:42,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:43,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:44,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:45,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:46,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:47,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:47,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:48,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:49,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:50,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:50,536 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:04:51,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:52,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:52,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:04:52,547 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:04:52,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:53,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:53,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:04:53,277 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:04:53,278 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:04:53,317 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:04:54,087 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:04:54,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:55,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:56,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:57,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:58,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:04:58,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:04:59,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:00,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:01,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:02,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:03,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:03,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:04,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:05,230 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:06,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:07,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:07,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:05:07,547 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:05:08,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:09,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:09,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:10,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:11,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:05:11,265 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:05:11,266 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:05:11,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:11,323 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:05:11,497 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:05:12,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:13,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:14,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:14,758 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:15,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:16,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:17,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:18,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:19,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:19,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:20,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:20,544 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:05:21,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:22,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:22,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:05:22,547 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:05:23,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:24,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:25,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:25,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:26,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:27,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:28,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:29,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:05:29,382 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:05:29,382 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:05:29,423 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:05:29,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:29,919 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:05:30,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:30,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:31,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:32,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:33,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:34,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:35,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:35,635 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:36,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:37,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:05:37,547 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:05:37,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:38,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:39,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:40,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:41,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:41,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:42,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:43,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:44,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:45,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:46,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:46,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:47,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:48,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:05:48,586 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:05:48,586 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:05:48,623 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:05:48,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:49,418 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:05:49,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:50,538 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:05:50,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:51,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:51,639 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:52,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:52,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:05:52,667 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:05:53,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:54,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:55,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:56,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:56,969 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:05:57,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:58,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:05:59,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:00,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:01,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:02,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:02,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:03,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:04,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:05,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:06,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:07,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:06:07,154 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:06:07,154 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:06:07,212 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:06:07,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:06:07,754 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:06:07,758 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:07,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:07,902 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:06:08,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:09,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:11,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:12,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:12,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:13,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:14,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:15,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:16,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:17,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:18,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:18,226 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:19,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:20,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:20,540 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:06:21,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:22,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:22,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:06:22,756 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:06:23,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:23,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:24,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:25,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:25,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:06:25,353 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:06:25,354 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:06:25,415 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:06:26,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:26,346 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:06:27,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:28,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:28,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:29,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:30,357 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:31,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:32,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:33,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:33,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:34,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:35,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:36,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:37,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:37,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:06:37,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:06:38,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:39,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:39,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:40,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:41,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:42,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:43,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:44,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:06:44,150 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:06:44,150 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:06:44,218 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:06:44,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:44,787 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:06:45,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:45,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:46,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:47,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:48,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:49,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:50,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:50,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:50,542 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:06:51,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:52,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:52,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:06:52,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:06:53,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:54,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:55,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:56,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:06:56,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:57,522 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:58,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:06:59,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:00,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:01,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:01,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:02,645 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:02,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:07:02,946 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:07:02,946 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:07:02,997 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:07:03,178 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:07:03,645 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:04,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:05,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:06,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:07,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:07,675 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:07,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:07:07,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:07:08,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:09,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:10,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:11,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:12,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:12,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:13,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:14,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:15,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:16,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:17,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:17,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:18,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:19,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:20,543 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:07:20,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:07:20,694 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:07:20,694 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:07:20,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:20,747 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:07:21,543 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:07:21,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:22,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:22,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:07:22,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:07:22,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:23,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:24,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:25,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:26,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:27,694 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:27,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:28,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:29,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:30,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:31,695 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:32,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:32,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:33,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:34,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:35,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:36,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:37,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:37,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:07:37,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:07:37,988 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:38,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:39,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:40,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:07:40,602 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:07:40,602 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:07:40,639 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:07:40,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:40,999 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:07:41,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:42,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:43,116 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:43,697 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:44,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:45,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:46,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:47,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:48,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:48,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:49,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:50,551 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:07:50,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:51,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:52,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:52,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:07:52,756 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:07:53,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:53,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:54,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:55,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:56,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:57,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:58,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:07:58,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:07:59,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:00,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:01,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:02,701 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:03,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:03,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:04,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:05,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:06,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:07,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:07,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:08:07,765 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:08:08,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:08,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:09,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:10,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:11,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:12,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:13,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:13,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:14,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:15,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:16,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:17,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:18,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:18,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:19,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:20,545 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:08:20,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:21,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:22,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:22,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:08:22,756 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:08:23,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:23,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:24,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:25,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:26,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:27,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:28,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:28,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:29,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:29,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:08:29,870 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:08:29,871 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:08:29,916 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:08:30,189 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:08:30,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:31,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:32,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:33,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:34,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:34,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:35,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:36,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:37,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:37,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:08:37,756 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:08:38,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:39,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:39,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:40,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:41,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:42,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:43,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:44,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:45,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:45,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:46,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:47,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:48,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:08:48,014 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:08:48,014 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:08:48,052 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:08:48,605 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:08:48,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:49,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:50,547 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:08:50,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:50,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:51,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:52,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:08:52,814 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:08:52,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:53,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:54,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:55,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:08:55,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:56,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:57,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:58,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:08:59,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:00,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:01,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:01,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:02,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:04,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:05,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:05,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:09:05,693 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:09:05,694 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:09:05,726 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:09:05,956 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:09:06,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:06,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:07,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:07,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:09:07,814 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:09:08,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:09,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:10,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:11,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:12,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:12,610 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:13,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:14,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:15,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:16,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:17,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:17,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:18,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:19,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:20,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:20,548 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:09:21,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:22,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:22,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:09:22,815 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:09:23,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:23,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:24,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:25,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:09:25,161 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:09:25,161 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:09:25,191 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:09:25,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:25,480 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:09:26,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:27,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:28,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:28,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:29,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:30,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:31,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:32,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:33,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:33,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:34,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:35,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:36,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:37,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:37,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:09:37,815 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:09:38,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:38,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:39,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:40,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:41,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:42,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:43,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:09:43,466 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:09:43,466 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:09:43,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:43,509 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:09:43,939 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:09:44,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:44,510 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:45,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:46,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:47,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:48,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:49,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:49,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:50,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:50,550 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:09:51,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:52,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:52,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:09:52,829 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:09:53,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:54,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:55,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:55,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:09:56,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:57,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:58,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:09:59,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:00,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:00,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:01,040 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:10:01,041 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:10:01,042 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:10:01,090 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:10:01,339 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:10:01,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:02,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:03,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:04,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:05,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:06,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:06,604 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:07,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:07,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:10:07,815 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:10:08,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:09,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:10,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:11,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:12,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:12,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:13,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:14,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:15,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:16,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:17,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:17,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:18,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:19,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:20,551 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:10:20,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:10:20,825 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:10:20,826 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:10:20,858 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:10:20,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:21,251 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:10:21,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:22,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:10:22,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:10:22,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:22,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:23,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:24,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:25,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:27,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:27,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:28,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:29,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:30,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:31,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:32,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:33,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:33,603 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:34,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:35,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:36,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:37,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:37,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:10:37,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:10:38,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:38,680 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:38,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:10:38,721 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:10:38,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:10:38,768 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:10:39,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:39,619 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:10:40,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:41,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:42,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:43,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:44,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:44,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:45,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:46,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:47,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:48,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:49,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:49,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:50,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:50,552 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:10:51,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:52,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:52,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:10:52,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:10:53,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:54,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:54,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:10:55,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:56,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:57,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:57,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:10:57,986 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:10:57,986 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:10:58,025 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:10:58,027 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:10:58,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:10:59,048 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:10:59,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:00,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:00,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:01,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:02,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:03,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:04,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:05,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:06,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:06,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:07,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:07,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:11:07,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:11:08,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:09,565 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:10,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:11,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:11,962 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:12,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:13,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:14,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:15,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:16,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:11:16,114 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:11:16,114 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:11:16,182 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:11:16,395 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:11:16,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:17,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:17,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:18,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:19,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:20,553 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:11:20,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:21,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:22,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:22,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:22,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:11:22,861 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:11:23,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:24,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:25,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:26,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:27,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:27,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:28,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:29,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:30,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:31,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:32,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:32,573 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:33,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:34,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:35,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:11:35,106 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:11:35,106 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:11:35,157 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:11:35,810 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:11:35,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:36,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:37,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:37,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:11:37,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:11:37,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:38,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:39,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:40,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:41,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:42,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:42,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:43,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:44,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:45,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:46,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:47,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:47,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:48,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:49,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:50,554 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:11:50,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:51,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:52,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:11:52,816 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:11:52,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:53,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:53,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:54,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:55,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:56,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:57,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:58,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:11:58,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:11:59,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:00,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:01,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:02,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:03,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:03,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:04,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:05,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:06,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:07,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:12:07,817 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:12:07,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:08,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:08,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:09,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:10,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:11,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:12,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:13,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:13,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:14,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:15,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:16,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:17,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:18,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:18,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:19,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:20,556 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:12:20,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:21,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:22,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:12:22,817 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:12:22,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:23,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:23,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:23,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:12:23,991 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:12:23,991 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:12:24,035 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:12:24,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:25,012 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:12:25,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:26,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:27,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:28,484 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:28,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:29,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:30,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:31,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:32,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:34,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:34,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:35,156 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:36,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:37,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:37,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:12:37,817 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:12:38,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:39,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:39,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:40,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:41,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:42,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:43,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:44,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:44,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:12:44,338 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:12:44,338 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:12:44,387 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:12:44,441 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:12:45,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:45,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:46,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:47,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:48,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:49,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:50,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:50,557 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:12:50,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:51,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:52,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:52,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:12:52,817 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:12:53,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:54,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:55,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:56,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:56,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:12:57,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:58,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:12:59,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:00,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:01,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:01,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:02,040 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:13:02,041 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:13:02,042 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:13:02,072 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:13:02,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:02,821 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:13:03,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:04,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:05,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:06,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:07,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:07,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:07,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:13:07,817 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:13:08,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:09,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:10,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:11,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:12,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:13,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:13,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:14,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:15,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:16,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:17,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:18,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:18,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:19,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:20,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:20,559 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:13:21,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:21,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:13:21,657 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:13:21,657 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:13:21,745 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:13:22,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:22,333 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:13:22,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:13:22,818 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:13:23,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:23,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:24,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:25,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:26,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:27,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:28,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:28,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:29,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:30,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:31,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:32,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:33,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:33,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:34,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:35,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:36,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:37,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:37,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:13:37,818 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:13:38,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:38,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:39,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:39,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:13:39,621 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:13:39,622 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:13:39,665 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:13:40,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:40,666 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:13:41,320 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:42,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:43,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:44,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:44,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:45,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:46,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:47,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:48,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:49,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:50,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:50,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:50,560 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:13:51,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:52,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:52,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:13:52,818 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:13:53,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:54,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:55,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:55,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:13:56,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:57,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:13:57,285 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:13:57,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:13:57,357 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:13:57,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:58,089 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:13:58,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:13:59,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:00,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:01,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:01,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:02,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:03,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:04,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:05,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:06,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:06,487 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:07,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:07,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:14:07,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:14:08,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:09,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:10,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:11,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:12,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:12,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:13,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:14,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:15,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:16,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:14:16,133 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:14:16,133 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:14:16,165 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:14:16,454 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:14:16,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:17,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:17,670 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:18,670 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:19,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:20,561 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:14:20,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:21,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:22,503 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:22,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:22,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:14:22,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:14:23,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:24,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:25,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:26,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:27,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:27,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:28,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:29,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:30,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:31,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:32,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:33,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:33,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:34,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:35,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:14:35,369 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:14:35,370 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:14:35,417 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:14:35,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:35,913 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:14:36,989 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:37,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:14:37,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:14:38,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:38,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:39,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:40,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:41,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:42,326 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:43,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:43,326 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:44,327 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:45,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:46,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:47,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:48,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:48,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:49,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:50,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:50,563 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:14:51,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:52,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:52,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:14:52,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:14:53,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:54,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:14:54,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:54,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:14:54,473 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:14:54,474 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:14:54,539 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:14:55,326 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:14:55,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:56,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:57,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:58,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:59,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:14:59,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:00,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:01,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:02,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:03,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:04,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:05,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:05,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:06,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:07,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:07,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:15:07,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:15:08,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:09,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:10,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:10,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:11,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:12,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:12,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:15:12,697 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:15:12,697 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:15:12,747 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:15:12,750 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:15:13,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:14,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:15,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:16,353 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:16,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:17,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:18,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:19,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:20,564 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:15:20,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:21,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:22,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:22,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:22,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:15:22,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:15:23,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:24,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:25,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:27,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:27,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:28,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:29,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:30,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:31,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:32,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:32,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:15:32,286 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:15:32,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:15:32,347 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:15:32,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:33,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:33,228 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:15:34,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:35,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:36,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:37,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:37,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:37,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:15:37,819 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:15:38,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:39,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:40,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:41,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:42,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:42,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:43,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:44,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:45,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:46,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:47,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:47,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:48,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:49,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:50,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:50,566 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:15:51,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:52,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:52,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:15:52,820 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:15:52,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:53,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:54,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:55,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:56,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:57,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:58,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:15:58,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:15:59,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:00,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:01,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:02,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:03,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:03,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:04,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:05,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:06,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:07,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:07,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:16:07,820 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:16:08,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:08,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:09,219 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:10,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:11,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:12,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:13,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:13,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:14,221 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:15,221 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:16,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:17,221 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:18,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:18,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:19,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:20,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:20,566 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:16:21,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:21,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:16:21,335 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:16:21,335 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:16:21,387 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:16:22,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:22,345 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:16:22,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:16:22,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:16:23,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:23,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:24,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:25,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:26,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:27,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:28,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:28,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:29,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:30,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:31,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:32,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:33,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:34,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:34,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:35,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:36,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:37,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:37,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:16:37,820 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:16:38,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:39,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:39,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:40,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:40,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:16:40,657 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:16:40,658 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:16:40,697 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:16:40,736 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:16:41,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:42,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:43,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:44,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:45,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:45,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:46,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:47,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:48,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:49,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:50,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:50,568 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:16:50,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:51,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:52,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:52,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:16:52,821 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:16:53,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:54,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:55,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:55,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:16:56,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:57,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:58,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:16:59,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:00,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:17:00,201 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:17:00,202 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:17:00,253 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:17:00,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:01,227 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:17:01,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:01,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:02,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:03,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:04,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:05,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:06,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:06,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:07,662 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:07,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:17:07,823 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:17:08,662 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:09,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:10,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:11,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:11,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:12,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:13,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:14,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:15,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:16,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:17,649 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:17,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:18,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:18,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:17:18,861 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:17:18,862 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:17:18,900 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:17:19,611 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:17:19,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:20,569 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:17:20,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:21,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:22,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:22,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:22,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:17:22,823 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:17:23,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:24,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:25,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:26,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:27,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:28,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:28,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:29,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:30,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:31,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:32,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:33,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:33,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:34,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:35,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:36,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:37,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:37,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:17:37,823 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:17:38,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:38,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:17:38,457 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:17:38,457 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:17:38,508 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:17:38,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:39,068 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:17:39,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:40,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:41,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:42,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:43,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:43,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:44,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:45,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:46,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:47,802 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:48,803 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:49,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:49,803 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:50,570 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:17:50,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:51,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:52,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:52,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:17:52,824 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:17:53,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:54,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:17:54,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:55,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:56,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:17:56,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:17:56,426 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:17:56,491 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:17:56,496 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:17:56,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:57,512 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:17:57,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:58,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:17:59,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:00,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:00,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:01,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:02,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:03,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:04,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:05,716 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:05,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:06,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:07,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:18:07,824 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:18:07,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:08,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:09,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:10,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:11,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:11,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:12,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:13,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:14,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:18:14,349 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:18:14,350 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:18:14,396 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:18:14,923 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:18:14,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:15,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:16,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:17,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:17,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:18,951 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:20,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:20,572 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:18:21,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:22,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:22,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:18:22,825 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:18:22,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:23,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:24,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:25,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:26,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:27,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:28,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:28,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:29,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:30,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:31,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:32,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:33,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:33,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:33,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:18:33,793 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:18:33,794 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:18:33,858 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:18:34,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:34,349 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:18:35,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:36,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:37,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:37,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:18:37,825 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:18:38,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:38,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:39,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:40,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:41,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:42,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:43,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:43,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:44,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:45,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:46,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:47,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:48,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:48,282 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:49,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:50,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:50,573 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:18:51,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:51,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:18:51,498 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:18:51,498 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:18:51,541 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:18:51,781 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:18:52,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:52,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:18:52,825 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:18:53,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:54,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:54,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:18:55,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:56,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:57,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:58,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:59,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:18:59,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:00,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:01,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:02,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:03,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:04,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:04,736 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:05,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:06,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:07,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:07,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:19:07,825 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:19:08,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:09,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:09,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:10,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:11,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:11,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:19:11,574 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:19:11,574 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:19:11,627 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:19:12,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:12,238 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:19:13,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:14,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:14,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:15,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:16,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:17,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:18,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:19,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:20,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:20,574 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:19:20,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:21,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:22,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:22,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:19:22,865 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:19:23,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:24,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:25,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:25,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:26,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:27,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:28,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:29,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:29,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:19:29,554 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:19:29,554 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:19:29,588 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:19:29,643 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:19:30,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:30,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:31,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:32,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:33,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:34,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:35,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:35,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:36,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:37,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:37,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:19:37,827 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:19:38,389 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:39,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:40,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:40,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:41,390 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:42,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:43,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:44,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:45,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:45,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:46,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:47,391 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:48,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:49,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:50,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:50,575 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:19:51,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:51,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:52,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:52,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:19:52,827 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:19:53,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:54,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:55,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:56,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:19:56,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:57,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:58,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:19:59,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:00,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:01,154 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:01,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:02,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:03,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:04,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:05,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:06,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:06,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:07,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:07,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:20:07,827 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:20:08,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:09,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:10,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:11,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:11,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:12,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:13,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:14,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:15,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:16,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:16,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:17,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:18,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:18,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:20:18,988 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:20:18,988 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:20:19,033 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:20:19,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:19,772 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:20:20,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:20,577 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:20:21,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:21,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:22,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:22,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:20:22,827 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:20:23,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:24,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:25,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:26,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:27,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:27,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:28,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:29,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:30,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:31,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:32,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:32,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:33,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:34,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:35,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:36,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:37,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:20:37,827 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:20:37,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:37,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:38,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:20:38,121 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:20:38,121 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:20:38,160 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:20:38,255 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:20:38,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:39,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:40,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:41,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:42,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:43,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:43,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:44,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:45,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:46,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:47,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:48,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:49,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:49,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:50,578 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:20:50,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:51,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:52,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:20:52,828 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:20:52,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:53,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:54,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:20:54,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:56,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:57,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:58,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:20:58,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:20:58,493 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:20:58,494 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:20:58,532 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:20:58,706 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:20:59,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:00,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:00,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:01,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:02,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:03,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:04,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:05,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:06,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:06,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:07,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:07,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:21:07,977 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:21:08,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:09,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:10,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:11,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:12,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:12,407 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:13,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:14,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:15,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:16,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:16,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:21:16,645 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:21:16,645 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:21:16,688 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:21:17,064 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:21:17,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:17,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:18,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:19,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:20,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:20,579 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:21:21,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:22,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:23,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:21:23,018 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:21:23,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:23,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:24,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:25,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:26,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:27,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:28,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:28,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:29,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:30,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:31,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:32,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:33,295 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:33,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:34,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:21:34,205 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:21:34,205 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:21:34,259 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:21:34,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:34,514 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:21:35,315 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:36,315 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:37,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:38,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:21:38,018 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:21:38,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:38,409 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:39,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:40,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:41,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:42,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:43,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:43,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:44,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:45,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:46,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:47,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:48,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:49,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:49,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:50,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:50,581 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:21:51,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:21:51,301 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:21:51,302 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:21:51,349 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:21:51,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:51,875 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:21:52,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:53,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:21:53,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:21:53,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:54,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:21:54,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:55,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:56,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:57,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:58,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:59,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:21:59,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:00,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:01,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:02,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:03,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:04,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:05,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:05,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:06,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:07,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:08,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:22:08,018 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:22:08,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:09,415 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:09,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:22:09,841 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:22:09,842 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:22:09,880 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:22:10,371 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:22:10,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:10,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:11,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:12,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:13,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:14,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:15,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:16,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:16,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:17,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:18,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:19,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:20,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:20,582 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:22:21,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:21,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:22,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:23,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:22:23,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:22:23,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:24,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:25,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:26,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:27,314 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:27,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:28,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:22:28,189 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:22:28,190 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:22:28,248 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:22:28,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:28,743 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:22:29,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:30,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:31,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:32,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:32,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:33,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:34,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:35,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:36,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:37,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:38,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:22:38,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:22:38,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:38,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:39,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:40,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:41,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:42,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:43,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:43,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:44,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:45,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:46,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:22:46,484 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:22:46,484 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:22:46,532 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:22:46,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:47,138 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:22:47,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:48,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:49,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:49,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:50,584 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:22:50,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:51,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:52,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:53,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:22:53,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:22:53,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:54,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:55,283 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:22:55,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:56,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:57,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:58,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:22:59,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:00,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:00,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:01,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:02,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:03,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:04,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:05,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:23:05,334 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:23:05,334 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:23:05,394 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:23:05,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:05,636 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:23:06,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:06,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:07,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:08,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:23:08,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:23:08,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:09,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:10,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:11,504 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:11,639 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:12,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:13,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:14,639 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:15,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:16,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:17,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:17,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:18,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:19,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:20,585 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:23:20,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:21,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:22,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:22,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:23,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:23:23,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:23:23,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:24,113 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:23:24,114 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:23:24,115 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:23:24,173 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:23:24,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:25,036 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:23:25,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:26,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:27,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:27,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:28,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:29,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:30,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:31,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:32,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:33,118 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:33,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:34,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:35,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:36,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:37,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:38,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:23:38,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:23:38,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:38,938 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:39,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:40,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:41,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:42,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:43,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:43,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:44,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:45,939 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:46,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:47,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:48,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:48,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:49,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:50,586 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:23:50,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:51,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:52,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:53,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:23:53,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:23:53,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:53,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:54,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:55,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:56,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:57,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:58,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:23:58,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:23:59,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:00,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:01,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:02,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:03,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:03,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:04,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:05,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:06,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:07,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:08,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:24:08,019 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:24:08,719 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:08,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:09,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:10,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:11,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:12,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:13,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:13,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:24:13,931 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:24:13,931 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:24:13,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:13,975 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:24:14,107 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:24:14,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:15,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:16,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:18,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:19,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:19,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:20,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:20,587 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:24:21,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:22,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:23,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:24:23,020 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:24:23,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:24,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:24,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:25,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:26,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:27,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:28,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:29,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:29,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:30,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:31,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:31,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:24:31,461 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:24:31,462 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:24:31,515 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:24:31,529 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:24:32,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:32,539 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:24:33,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:34,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:34,642 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:35,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:36,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:37,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:38,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:24:38,020 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:24:38,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:39,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:40,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:40,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:41,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:42,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:43,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:44,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:45,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:45,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:46,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:47,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:48,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:49,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:50,156 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:24:50,157 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:24:50,157 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:24:50,197 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:24:50,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:50,588 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:24:50,943 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:24:51,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:51,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:52,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:53,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:24:53,020 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:24:53,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:54,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:55,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:56,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:56,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:24:57,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:58,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:24:59,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:00,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:01,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:02,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:02,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:03,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:04,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:05,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:06,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:07,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:08,040 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:08,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:25:08,273 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:25:08,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:08,961 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:25:08,962 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:25:08,962 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:25:09,009 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:25:09,353 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:25:09,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:10,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:11,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:12,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:13,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:13,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:14,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:15,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:16,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:17,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:18,367 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:18,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:19,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:20,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:20,596 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:25:21,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:22,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:23,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:25:23,273 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:25:23,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:23,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:24,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:25,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:26,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:27,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:25:27,094 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:25:27,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:25:27,147 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:25:27,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:27,725 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:25:28,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:28,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:29,420 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:30,421 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:31,421 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:32,421 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:33,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:34,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:34,585 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:35,583 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:36,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:37,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:38,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:25:38,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:25:38,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:39,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:40,584 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:40,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:41,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:42,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:43,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:44,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:45,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:46,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:46,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:46,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:25:46,830 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:25:46,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:25:46,864 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:25:47,155 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:25:47,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:48,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:49,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:50,590 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:25:50,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:51,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:51,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:52,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:53,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:25:53,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:25:53,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:54,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:55,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:56,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:57,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:25:57,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:58,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:25:59,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:00,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:01,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:02,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:03,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:03,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:04,682 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:05,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:26:05,685 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:05,686 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:26:05,686 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:26:05,742 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:26:06,657 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:26:06,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:07,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:08,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:26:08,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:26:08,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:08,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:09,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:10,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:11,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:12,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:13,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:13,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:14,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:15,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:16,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:17,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:18,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:18,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:19,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:20,593 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:26:20,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:21,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:22,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:23,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:26:23,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:26:23,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:23,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:24,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:25,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:26:25,078 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:26:25,078 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:26:25,131 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:26:25,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:26,021 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:26:27,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:28,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:28,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:29,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:30,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:31,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:32,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:33,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:33,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:34,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:35,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:36,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:37,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:38,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:38,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:26:38,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:26:39,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:39,586 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:40,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:41,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:42,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:43,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:44,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:44,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:26:44,570 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:26:44,570 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:26:44,615 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:26:44,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:45,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:45,517 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:26:46,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:47,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:48,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:49,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:50,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:50,114 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:50,594 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:26:51,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:52,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:53,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:53,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:26:53,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:26:54,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:55,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:55,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:26:56,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:57,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:58,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:26:59,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:00,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:01,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:01,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:02,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:03,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:03,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:27:03,626 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:27:03,626 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:27:03,703 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:27:03,950 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:27:04,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:05,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:06,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:06,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:07,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:08,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:08,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:27:08,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:27:09,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:10,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:11,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:12,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:12,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:13,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:14,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:15,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:16,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:17,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:17,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:18,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:19,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:20,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:20,595 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:27:21,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:22,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:27:22,354 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:27:22,354 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:27:22,390 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:27:22,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:23,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:23,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:27:23,274 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:27:23,329 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:27:23,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:24,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:25,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:26,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:27,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:28,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:28,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:29,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:30,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:31,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:32,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:33,307 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:33,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:34,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:35,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:36,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:37,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:38,274 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:27:38,275 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:27:38,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:38,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:39,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:40,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:41,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:42,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:43,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:43,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:44,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:45,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:46,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:47,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:48,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:48,451 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:49,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:50,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:50,596 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:27:51,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:52,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:53,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:27:53,275 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:27:53,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:53,573 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:54,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:55,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:56,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:57,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:58,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:27:58,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:27:59,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:00,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:01,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:02,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:03,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:03,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:04,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:05,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:06,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:07,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:08,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:28:08,275 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:28:08,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:08,681 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:09,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:10,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:11,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:11,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:28:11,790 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:28:11,790 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:28:11,845 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:28:12,415 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:28:12,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:13,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:13,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:14,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:15,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:16,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:17,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:18,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:18,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:19,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:20,597 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:28:20,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:21,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:22,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:23,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:28:23,275 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:28:23,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:23,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:24,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:25,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:26,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:27,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:29,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:29,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:30,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:31,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:31,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:28:31,141 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:28:31,141 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:28:31,197 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:28:31,928 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:28:32,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:33,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:34,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:34,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:35,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:36,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:37,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:38,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:38,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:28:38,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:28:39,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:40,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:40,486 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:41,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:42,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:43,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:44,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:45,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:45,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:46,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:47,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:48,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:49,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:50,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:28:50,221 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:50,221 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:28:50,222 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:28:50,271 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:28:50,314 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:28:50,598 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:28:51,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:51,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:52,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:53,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:53,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:28:53,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:28:54,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:55,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:56,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:57,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:57,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:28:58,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:28:59,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:00,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:01,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:02,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:02,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:03,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:04,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:05,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:06,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:07,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:08,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:08,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:29:08,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:29:08,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:09,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:09,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:29:09,805 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:29:09,806 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:29:09,848 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:29:10,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:10,729 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:29:11,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:12,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:13,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:13,452 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:14,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:15,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:16,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:17,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:18,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:18,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:19,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:20,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:20,599 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:29:21,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:22,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:23,275 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:29:23,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:29:23,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:23,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:24,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:25,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:26,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:27,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:28,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:29,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:29,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:29:29,342 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:29:29,342 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:29:29,392 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:29:29,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:30,139 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:29:30,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:31,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:32,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:33,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:34,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:34,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:35,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:36,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:37,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:38,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:29:38,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:29:38,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:39,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:39,949 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:40,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:41,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:42,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:43,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:44,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:45,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:45,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:46,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:47,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:47,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:29:47,970 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:29:47,970 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:29:48,016 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:29:48,506 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:29:48,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:49,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:50,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:50,600 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:29:50,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:51,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:52,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:53,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:29:53,276 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:29:53,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:54,532 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:55,532 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:56,153 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:29:56,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:57,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:58,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:29:59,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:00,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:01,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:01,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:02,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:03,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:04,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:05,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:06,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:06,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:30:06,898 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:30:06,899 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:30:06,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:06,936 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:30:07,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:07,901 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:30:08,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:30:08,285 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:30:08,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:09,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:10,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:11,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:12,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:12,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:13,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:14,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:15,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:16,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:17,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:17,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:18,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:19,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:20,602 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:30:20,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:21,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:22,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:22,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:23,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:30:23,285 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:30:23,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:24,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:25,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:30:25,661 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:30:25,662 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:30:25,727 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:30:25,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:26,237 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:30:26,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:27,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:27,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:28,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:29,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:30,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:31,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:32,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:33,281 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:33,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:34,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:35,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:36,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:37,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:38,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:30:38,285 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:30:38,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:38,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:40,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:41,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:42,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:43,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:43,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:44,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:45,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:45,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:30:45,678 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:30:45,678 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:30:45,732 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:30:45,735 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:30:46,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:46,760 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:30:47,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:48,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:48,979 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:49,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:50,006 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:50,603 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:30:51,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:52,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:53,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:53,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:30:53,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:30:54,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:30:54,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:55,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:56,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:57,147 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:58,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:59,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:30:59,979 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:00,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:01,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:02,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:03,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:04,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:04,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:05,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:31:05,026 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:31:05,026 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:31:05,066 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:31:05,148 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:31:05,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:06,149 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:07,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:08,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:08,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:31:08,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:31:09,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:10,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:10,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:11,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:12,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:13,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:14,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:15,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:15,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:16,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:17,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:18,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:19,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:20,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:20,612 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:31:21,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:21,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:22,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:23,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:31:23,166 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:31:23,166 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:31:23,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:23,267 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:31:23,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:31:23,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:31:23,466 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:31:24,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:25,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:26,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:26,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:27,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:28,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:29,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:30,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:31,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:31,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:32,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:33,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:34,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:35,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:36,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:36,573 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:37,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:38,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:38,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:31:38,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:31:39,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:40,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:41,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:41,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:42,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:43,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:44,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:45,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:46,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:46,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:47,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:48,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:49,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:50,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:50,605 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:31:51,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:51,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:52,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:53,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:53,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:31:53,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:31:54,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:55,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:56,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:57,053 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:31:57,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:58,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:31:59,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:00,269 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:01,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:02,113 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:02,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:03,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:04,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:05,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:06,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:07,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:07,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:08,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:08,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:32:08,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:32:09,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:10,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:11,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:12,271 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:12,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:12,793 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:32:12,794 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:32:12,794 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:32:12,829 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:32:13,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:13,539 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:32:14,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:15,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:16,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:17,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:17,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:18,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:19,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:20,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:20,606 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:32:21,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:22,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:23,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:23,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:23,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:32:23,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:32:24,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:25,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:26,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:27,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:28,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:28,758 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:29,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:30,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:31,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:32:31,141 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:32:31,142 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:32:31,195 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:32:31,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:31,966 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:32:32,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:33,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:33,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:34,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:35,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:36,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:37,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:38,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:32:38,373 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:32:38,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:38,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:39,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:40,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:41,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:42,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:43,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:43,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:44,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:45,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:46,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:47,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:48,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:49,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:49,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:50,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:50,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:32:50,562 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:32:50,562 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:32:50,628 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:32:50,629 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:32:51,386 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:32:51,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:52,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:53,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:32:53,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:32:53,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:54,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:55,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:32:55,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:56,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:57,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:58,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:32:59,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:00,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:00,647 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:01,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:02,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:03,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:04,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:05,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:05,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:06,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:07,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:08,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:33:08,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:33:08,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:08,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:33:08,849 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:33:08,850 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:33:08,893 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:33:09,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:09,731 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:33:10,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:11,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:11,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:12,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:13,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:14,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:15,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:16,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:16,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:17,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:18,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:19,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:20,609 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:33:20,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:21,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:21,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:22,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:23,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:33:23,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:33:23,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:24,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:25,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:26,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:27,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:27,632 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:33:27,634 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:33:27,634 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:33:27,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:27,676 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:33:28,129 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:33:28,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:29,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:30,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:31,670 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:32,670 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:33,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:33,670 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:34,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:35,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:36,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:37,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:38,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:38,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:33:38,536 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:33:38,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:39,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:40,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:41,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:42,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:43,638 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:43,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:44,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:45,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:46,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:47,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:33:47,494 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:33:47,494 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:33:47,543 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:33:47,548 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:33:47,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:48,854 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:48,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:50,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:50,611 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:33:51,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:52,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:53,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:53,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:33:53,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:33:53,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:54,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:55,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:56,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:57,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:58,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:33:58,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:33:59,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:00,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:01,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:02,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:03,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:03,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:04,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:04,636 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:34:04,638 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:34:04,638 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:34:04,679 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:34:04,929 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:34:05,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:06,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:07,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:08,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:08,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:34:08,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:34:09,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:09,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:10,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:11,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:12,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:13,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:14,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:15,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:15,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:16,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:17,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:18,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:19,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:20,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:20,612 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:34:20,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:21,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:22,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:23,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:23,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:34:23,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:34:24,079 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:24,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:34:24,721 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:34:24,722 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:34:24,758 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:34:25,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:25,344 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:34:25,759 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:26,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:27,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:28,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:29,086 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:30,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:31,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:31,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:32,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:33,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:34,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:35,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:36,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:36,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:37,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:38,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:38,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:34:38,577 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:34:39,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:40,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:41,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:41,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:41,940 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:34:41,942 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:34:41,942 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:34:41,977 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:34:42,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:42,734 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:34:43,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:44,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:45,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:46,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:47,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:47,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:48,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:49,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:50,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:50,612 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:34:51,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:52,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:52,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:53,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:53,564 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:34:53,564 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:34:54,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:55,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:56,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:57,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:57,649 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:34:58,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:34:59,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:00,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:01,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:02,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:35:02,106 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:35:02,106 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:35:02,162 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:35:02,252 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:35:02,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:03,163 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:03,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:04,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:05,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:06,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:07,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:08,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:08,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:35:08,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:35:08,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:09,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:10,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:11,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:12,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:13,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:14,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:14,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:15,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:16,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:17,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:18,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:19,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:19,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:20,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:20,614 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:35:20,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:35:20,770 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:35:20,770 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:35:20,821 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:35:21,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:21,702 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:35:22,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:23,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:23,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:35:23,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:35:24,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:24,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:25,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:26,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:27,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:28,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:29,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:29,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:30,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:31,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:32,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:33,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:34,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:34,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:35,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:36,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:37,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:38,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:38,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:35:38,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:35:39,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:39,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:40,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:41,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:42,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:43,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:44,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:44,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:45,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:46,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:47,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:48,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:49,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:49,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:50,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:50,615 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:35:51,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:52,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:53,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:53,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:35:53,537 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:35:54,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:35:54,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:55,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:56,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:57,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:58,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:59,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:35:59,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:00,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:01,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:02,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:03,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:04,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:04,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:05,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:06,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:07,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:08,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:08,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:36:08,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:36:09,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:09,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:10,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:36:10,020 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:36:10,020 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:36:10,081 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:36:10,473 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:10,814 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:36:11,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:12,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:13,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:14,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:15,138 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:15,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:16,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:17,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:18,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:19,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:20,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:20,616 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:36:20,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:21,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:22,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:23,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:36:23,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:36:23,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:24,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:25,661 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:25,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:26,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:27,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:28,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:29,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:36:29,033 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:36:29,034 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:36:29,099 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:36:29,216 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:36:29,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:30,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:31,661 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:31,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:32,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:33,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:34,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:35,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:36,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:37,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:37,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:38,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:36:38,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:36:38,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:39,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:40,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:41,930 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:42,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:42,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:43,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:44,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:45,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:46,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:47,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:36:47,521 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:36:47,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:36:47,588 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:36:47,649 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:36:47,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:48,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:48,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:49,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:50,617 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:36:50,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:51,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:52,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:53,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:36:53,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:36:53,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:53,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:54,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:55,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:56,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:57,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:58,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:36:58,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:36:59,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:00,945 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:01,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:02,946 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:03,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:04,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:04,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:05,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:06,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:37:06,270 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:37:06,270 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:37:06,315 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:37:06,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:07,069 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:37:07,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:08,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:37:08,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:37:08,967 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:09,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:10,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:10,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:11,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:12,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:13,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:14,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:15,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:16,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:17,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:18,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:19,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:20,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:20,618 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:37:21,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:21,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:22,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:23,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:23,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:37:23,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:37:24,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:25,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:25,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:37:25,538 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:37:25,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:37:25,591 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:37:26,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:26,508 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:37:26,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:27,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:28,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:29,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:30,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:31,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:32,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:32,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:33,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:34,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:35,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:36,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:37,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:38,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:38,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:38,538 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:37:38,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:37:39,083 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:40,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:41,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:42,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:43,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:43,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:44,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:37:44,053 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:37:44,054 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:37:44,115 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:37:44,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:44,996 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:37:45,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:46,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:47,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:48,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:48,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:49,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:50,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:50,629 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:37:51,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:52,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:53,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:53,576 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:37:53,576 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:37:54,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:54,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:37:55,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:56,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:57,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:58,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:37:59,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:00,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:00,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:01,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:02,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:02,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:38:02,797 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:38:02,798 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:38:02,846 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:38:03,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:03,499 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:38:04,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:05,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:05,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:06,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:07,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:08,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:08,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:38:08,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:38:09,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:10,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:11,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:11,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:12,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:13,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:14,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:15,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:16,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:16,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:17,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:18,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:19,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:20,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:20,621 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:38:21,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:21,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:22,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:38:22,229 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:38:22,230 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:38:22,272 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:38:22,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:22,983 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:38:23,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:23,539 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:38:23,539 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:38:24,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:25,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:26,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:27,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:27,494 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:28,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:29,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:30,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:31,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:32,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:32,573 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:33,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:34,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:35,466 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:36,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:37,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:37,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:38,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:38,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:38:38,542 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:38:39,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:40,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:40,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:38:40,729 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:38:40,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:38:40,760 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:38:41,387 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:38:41,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:42,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:43,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:43,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:44,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:45,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:46,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:47,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:48,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:48,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:49,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:50,622 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:38:50,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:51,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:52,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:53,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:38:53,543 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:38:53,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:53,753 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:54,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:55,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:56,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:57,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:58,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:38:59,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:38:59,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:00,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:39:00,237 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:39:00,238 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:39:00,285 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:39:00,853 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:39:00,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:01,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:02,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:03,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:04,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:04,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:05,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:06,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:07,999 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:08,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:39:08,543 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:39:08,999 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:09,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:09,999 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:10,999 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:12,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:13,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:14,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:14,997 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:15,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:16,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:17,177 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:18,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:18,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:39:18,950 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:39:18,950 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:39:18,982 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:39:19,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:19,258 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:39:20,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:20,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:20,629 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:39:21,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:22,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:23,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:23,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:39:23,543 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:39:24,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:25,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:25,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:26,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:27,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:28,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:29,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:30,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:30,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:31,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:32,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:33,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:34,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:35,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:35,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:36,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:37,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:38,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:38,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:39:38,543 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:39:39,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:40,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:40,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:41,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:42,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:43,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:44,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:45,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:45,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:46,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:47,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:48,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:49,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:50,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:50,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:50,624 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:39:51,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:52,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:53,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:53,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:39:53,543 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:39:54,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:55,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:55,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:39:56,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:57,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:58,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:39:59,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:00,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:00,445 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:01,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:02,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:03,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:04,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:05,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:05,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:06,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:07,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:08,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:08,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:40:08,210 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:40:08,211 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:40:08,262 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:40:08,364 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:40:08,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:40:08,589 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:40:09,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:10,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:11,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:11,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:12,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:13,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:14,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:15,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:16,175 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:16,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:17,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:18,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:19,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:20,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:20,625 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:40:21,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:22,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:22,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:23,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:23,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:40:23,616 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:40:24,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:25,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:26,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:27,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:28,146 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:28,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:29,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:29,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:40:29,537 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:40:29,538 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:40:29,580 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:40:29,890 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:40:30,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:31,183 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:32,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:33,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:34,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:34,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:35,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:36,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:37,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:38,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:38,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:40:38,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:40:39,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:39,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:40,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:41,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:42,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:43,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:44,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:44,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:45,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:46,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:47,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:48,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:49,184 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:40:49,185 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:40:49,186 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:40:49,233 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:40:49,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:49,287 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:40:49,311 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:50,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:50,626 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:40:51,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:52,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:53,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:53,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:40:53,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:40:54,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:55,029 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:40:55,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:56,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:57,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:58,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:40:59,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:00,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:00,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:01,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:02,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:03,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:04,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:05,293 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:05,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:06,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:07,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:08,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:41:08,101 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:41:08,102 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:41:08,168 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:41:08,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:08,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:41:08,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:41:08,747 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:41:09,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:10,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:10,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:11,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:12,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:13,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:14,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:15,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:15,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:16,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:17,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:18,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:19,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:20,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:20,628 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:41:21,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:21,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:22,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:23,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:41:23,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:41:23,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:24,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:25,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:26,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:26,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:41:26,393 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:41:26,393 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:41:26,447 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:41:26,592 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:27,157 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:41:27,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:28,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:29,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:30,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:31,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:31,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:32,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:33,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:34,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:35,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:36,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:36,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:37,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:38,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:41:38,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:41:38,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:39,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:40,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:41,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:42,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:42,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:43,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:44,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:45,608 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:41:45,609 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:41:45,610 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:41:45,644 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:41:45,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:46,599 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:41:46,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:47,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:48,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:48,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:50,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:50,629 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:41:51,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:52,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:53,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:53,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:41:53,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:41:53,720 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:54,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:55,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:56,209 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:57,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:58,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:41:58,723 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:41:59,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:00,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:01,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:02,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:03,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:04,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:04,220 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:04,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:42:04,325 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:42:04,326 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:42:04,358 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:42:04,985 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:42:05,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:06,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:07,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:08,211 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:08,590 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:42:08,590 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:42:09,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:09,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:10,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:11,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:12,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:13,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:14,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:14,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:15,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:16,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:17,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:18,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:19,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:20,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:20,640 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:42:20,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:21,223 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:22,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:22,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:42:22,806 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:42:22,806 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:42:22,837 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:42:23,371 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:42:23,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:23,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:42:23,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:42:24,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:25,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:26,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:26,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:27,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:28,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:29,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:30,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:31,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:31,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:32,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:33,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:34,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:35,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:36,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:37,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:37,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:38,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:38,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:42:38,892 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:42:39,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:40,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:41,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:41,580 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:42:41,581 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:42:41,582 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:42:41,618 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:42:41,800 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:42:42,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:42,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:43,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:44,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:45,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:46,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:47,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:48,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:48,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:49,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:50,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:50,631 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:42:51,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:52,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:53,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:53,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:53,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:42:53,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:42:54,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:55,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:56,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:57,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:58,757 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:42:58,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:42:59,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:00,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:43:00,497 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:43:00,497 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:43:00,544 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:43:00,797 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:01,258 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:43:02,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:03,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:04,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:04,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:05,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:06,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:07,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:08,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:08,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:43:08,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:43:09,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:09,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:10,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:11,003 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:12,003 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:13,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:14,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:15,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:15,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:16,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:17,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:18,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:19,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:20,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:20,465 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:20,632 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:43:21,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:43:21,021 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:43:21,021 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:43:21,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:21,085 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:43:21,808 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:43:22,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:23,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:23,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:43:23,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:43:24,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:25,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:25,595 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:26,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:27,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:28,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:29,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:30,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:30,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:31,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:32,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:33,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:34,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:35,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:35,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:36,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:37,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:38,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:38,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:43:38,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:43:39,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:40,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:40,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:41,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:42,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:43,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:44,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:45,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:45,886 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:46,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:47,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:48,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:49,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:50,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:50,634 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:43:50,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:51,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:52,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:53,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:53,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:43:53,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:43:54,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:55,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:56,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:56,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:43:57,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:58,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:43:59,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:00,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:01,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:01,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:02,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:03,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:04,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:05,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:06,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:06,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:07,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:08,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:08,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:44:08,893 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:44:09,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:10,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:10,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:44:10,109 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:44:10,110 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:44:10,157 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:44:10,992 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:44:11,158 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:11,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:12,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:13,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:14,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:15,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:16,207 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:16,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:17,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:18,210 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:19,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:20,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:20,635 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:44:21,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:21,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:22,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:23,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:23,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:44:23,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:44:24,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:25,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:26,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:27,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:27,634 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:28,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:29,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:30,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:44:30,082 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:44:30,082 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:44:30,136 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:44:30,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:30,433 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:44:31,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:32,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:33,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:33,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:34,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:35,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:36,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:37,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:38,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:38,444 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:38,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:44:38,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:44:39,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:40,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:41,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:42,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:43,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:43,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:44,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:45,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:46,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:47,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:48,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:48,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:44:48,557 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:44:48,558 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:44:48,621 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:44:48,926 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:44:49,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:49,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:50,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:50,636 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:44:51,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:52,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:53,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:53,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:44:53,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:44:54,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:54,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:44:55,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:56,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:57,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:58,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:44:59,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:00,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:00,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:01,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:02,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:03,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:04,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:05,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:05,469 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:06,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:07,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:45:07,353 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:45:07,354 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:45:07,392 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:45:07,403 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:45:07,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:08,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:08,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:45:08,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:45:09,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:10,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:11,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:11,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:12,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:13,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:14,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:15,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:16,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:16,882 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:17,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:18,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:19,435 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:20,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:20,637 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:45:21,436 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:21,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:22,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:23,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:23,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:45:23,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:45:24,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:25,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:25,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:45:25,954 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:45:25,954 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:45:25,987 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:45:26,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:26,828 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:45:26,987 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:27,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:28,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:29,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:30,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:31,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:32,483 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:32,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:33,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:34,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:35,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:36,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:37,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:38,033 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:38,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:38,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:45:38,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:45:39,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:40,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:41,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:42,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:43,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:43,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:44,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:45:44,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:45:44,426 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:45:44,470 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:45:44,474 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:45:44,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:45,484 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:45:45,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:46,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:47,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:48,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:49,078 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:49,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:50,639 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:45:50,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:51,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:52,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:53,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:53,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:45:53,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:45:54,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:54,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:55,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:56,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:57,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:58,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:45:59,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:45:59,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:00,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:01,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:02,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:03,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:04,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:46:04,401 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:46:04,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:46:04,513 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:46:04,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:04,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:05,033 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:46:06,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:07,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:08,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:08,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:46:08,895 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:46:09,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:10,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:10,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:11,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:12,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:13,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:14,057 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:15,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:15,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:16,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:17,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:18,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:19,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:20,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:20,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:20,640 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:46:21,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:22,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:23,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:23,894 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:46:23,895 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:46:24,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:24,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:46:24,434 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:46:24,434 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:46:24,477 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:46:24,550 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:46:25,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:26,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:26,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:27,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:28,059 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:29,060 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:30,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:31,072 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:32,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:32,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:33,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:34,073 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:35,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:36,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:37,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:38,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:38,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:38,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:46:38,895 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:46:39,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:40,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:41,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:42,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:43,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:43,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:44,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:45,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:46:45,209 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:46:45,210 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:46:45,259 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:46:45,324 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:46,088 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:46:46,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:47,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:48,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:49,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:49,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:50,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:50,641 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:46:51,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:52,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:53,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:53,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:46:53,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:46:54,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:54,587 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:46:55,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:56,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:57,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:58,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:59,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:46:59,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:00,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:01,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:01,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:47:01,937 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:47:01,938 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:47:01,988 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:47:02,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:02,457 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:47:03,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:04,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:04,635 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:05,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:06,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:07,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:08,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:08,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:47:08,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:47:09,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:09,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:10,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:11,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:12,537 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:13,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:14,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:15,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:15,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:16,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:17,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:18,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:19,543 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:20,643 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:47:20,644 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:20,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:21,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:47:21,398 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:47:21,398 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:47:21,429 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:47:21,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:21,930 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:47:22,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:23,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:23,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:47:23,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:47:24,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:25,748 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:25,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:26,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:27,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:28,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:29,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:30,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:30,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:31,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:32,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:33,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:34,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:35,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:35,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:36,771 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:37,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:38,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:38,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:47:38,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:47:39,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:40,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:40,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:41,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:42,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:43,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:44,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:45,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:46,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:46,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:47,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:48,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:49,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:50,644 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:47:50,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:51,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:51,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:52,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:53,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:53,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:47:53,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:47:54,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:55,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:56,253 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:47:56,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:57,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:58,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:47:59,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:00,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:01,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:01,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:02,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:03,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:04,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:05,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:06,458 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:06,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:07,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:08,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:08,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:48:08,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:48:09,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:10,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:11,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:48:11,073 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:48:11,073 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:48:11,110 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:48:11,209 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:48:11,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:12,111 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:12,777 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:13,777 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:14,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:15,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:16,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:17,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:17,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:18,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:19,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:20,645 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:48:20,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:21,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:22,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:23,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:23,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:23,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:48:23,896 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:48:24,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:25,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:26,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:27,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:28,926 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:29,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:29,925 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:30,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:48:30,069 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:48:30,070 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:48:30,126 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:48:30,761 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:48:30,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:31,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:32,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:33,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:34,357 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:34,941 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:35,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:36,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:37,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:38,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:48:38,897 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:48:38,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:39,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:39,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:40,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:41,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:43,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:44,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:45,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:45,318 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:46,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:47,008 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:48:47,009 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:48:47,010 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:48:47,069 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:48:47,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:47,114 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:48:48,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:49,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:50,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:50,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:50,646 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:48:51,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:52,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:53,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:53,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:48:53,897 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:48:54,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:55,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:56,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:48:56,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:57,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:58,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:48:59,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:00,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:01,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:01,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:02,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:03,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:04,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:04,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:49:04,817 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:49:04,818 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:49:04,857 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:49:05,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:05,553 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:49:06,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:06,761 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:07,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:08,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:08,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:49:08,897 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:49:09,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:10,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:11,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:12,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:12,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:13,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:14,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:15,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:16,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:17,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:17,687 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:18,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:19,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:20,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:20,647 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:49:21,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:22,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:23,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:23,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:24,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:49:24,071 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:49:24,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:24,504 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:49:24,506 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:49:24,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:49:24,543 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:49:24,936 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:49:25,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:26,394 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:27,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:28,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:29,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:29,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:30,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:31,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:32,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:33,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:34,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:34,992 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:35,397 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:36,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:37,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:38,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:39,070 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:49:39,071 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:49:39,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:40,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:40,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:41,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:42,398 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:43,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:44,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:49:44,202 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:49:44,202 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:49:44,258 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:49:44,397 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:49:44,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:45,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:45,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:46,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:47,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:48,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:49,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:50,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:50,649 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:49:51,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:51,650 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:52,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:53,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:54,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:49:54,072 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:49:54,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:55,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:56,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:57,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:49:57,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:58,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:49:59,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:00,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:01,499 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:02,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:02,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:03,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:04,500 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:50:04,501 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:50:04,502 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:50:04,533 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:50:04,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:04,871 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:50:05,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:06,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:07,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:08,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:08,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:09,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:50:09,072 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:50:09,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:10,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:11,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:12,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:13,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:13,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:14,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:15,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:16,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:17,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:18,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:19,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:19,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:20,650 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:50:20,666 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:21,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:22,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:23,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:24,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:50:24,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:50:24,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:24,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:50:24,376 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:50:24,377 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:50:24,422 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:50:24,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:25,287 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:50:25,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:26,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:27,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:28,667 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:29,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:30,023 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:30,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:31,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:32,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:33,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:34,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:35,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:35,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:36,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:37,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:38,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:39,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:50:39,213 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:50:39,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:40,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:41,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:41,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:42,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:43,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:50:43,134 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:50:43,134 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:50:43,205 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:50:43,753 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:50:43,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:44,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:45,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:46,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:46,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:47,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:48,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:49,956 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:50,651 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:50:50,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:51,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:51,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:52,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:53,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:54,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:50:54,213 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:50:54,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:55,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:56,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:57,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:50:57,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:58,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:50:59,958 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:00,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:01,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:51:01,798 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:51:01,798 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:51:01,864 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:51:01,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:02,157 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:51:02,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:02,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:03,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:04,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:06,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:07,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:08,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:08,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:09,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:09,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:51:09,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:51:10,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:11,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:12,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:13,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:13,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:14,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:15,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:16,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:17,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:18,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:19,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:19,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:20,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:20,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:51:20,518 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:51:20,518 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:51:20,574 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:51:20,638 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:51:20,653 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:51:21,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:22,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:23,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:24,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:24,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:51:24,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:51:24,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:25,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:26,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:27,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:28,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:29,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:29,297 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:30,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:31,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:32,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:33,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:34,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:34,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:35,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:36,238 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:37,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:38,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:39,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:51:39,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:51:39,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:39,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:40,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:41,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:42,239 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:43,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:44,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:44,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:45,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:46,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:47,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:48,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:49,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:49,509 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:50,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:50,654 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:51:51,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:52,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:53,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:54,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:51:54,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:51:54,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:54,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:51:55,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:56,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:57,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:58,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:59,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:51:59,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:00,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:01,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:02,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:03,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:04,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:04,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:05,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:06,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:07,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:08,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:09,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:52:09,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:52:09,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:09,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:10,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:52:10,103 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:52:10,103 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:52:10,139 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:52:10,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:10,749 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:52:11,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:12,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:13,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:14,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:15,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:15,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:16,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:17,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:18,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:19,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:20,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:20,655 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:52:20,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:21,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:22,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:23,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:24,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:52:24,241 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:52:24,322 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:25,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:26,080 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:26,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:27,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:28,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:28,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:52:28,517 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:52:28,518 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:52:28,562 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:52:29,102 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:52:29,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:30,323 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:31,361 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:31,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:32,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:33,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:34,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:35,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:36,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:36,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:37,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:38,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:39,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:52:39,215 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:52:39,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:40,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:41,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:41,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:42,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:43,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:44,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:45,572 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:46,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:46,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:47,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:47,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:52:47,853 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:52:47,854 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:52:47,889 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:52:48,519 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:52:48,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:49,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:50,668 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:52:50,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:51,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:52,326 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:52,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:53,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:54,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:52:54,215 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:52:54,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:55,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:56,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:57,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:58,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:52:58,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:52:59,801 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:00,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:01,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:02,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:03,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:03,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:04,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:05,913 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:06,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:53:06,306 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:53:06,306 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:53:06,374 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:53:06,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:06,982 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:53:07,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:08,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:09,114 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:09,215 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:53:09,215 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:53:09,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:10,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:11,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:12,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:13,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:14,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:14,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:15,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:16,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:18,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:19,027 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:19,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:20,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:20,658 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:53:21,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:22,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:23,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:24,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:24,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:53:24,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:53:24,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:24,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:53:24,764 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:53:24,764 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:53:24,818 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:53:25,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:25,430 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:53:26,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:27,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:28,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:29,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:30,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:30,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:31,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:32,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:33,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:34,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:35,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:36,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:36,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:37,142 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:38,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:39,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:39,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:53:39,216 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:53:40,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:41,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:41,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:42,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:43,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:44,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:45,316 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:53:45,317 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:53:45,318 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:53:45,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:45,367 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:53:45,868 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:53:46,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:46,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:47,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:48,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:49,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:50,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:50,659 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:53:51,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:51,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:52,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:53,353 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:54,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:53:54,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:53:54,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:55,353 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:56,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:57,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:53:57,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:58,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:53:59,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:00,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:01,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:02,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:02,598 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:03,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:04,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:04,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:54:04,701 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:54:04,702 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:54:04,754 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:54:05,327 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:54:05,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:06,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:07,493 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:08,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:08,524 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:09,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:54:09,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:54:09,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:10,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:11,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:12,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:13,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:13,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:14,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:15,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:16,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:17,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:18,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:18,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:19,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:20,661 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:54:20,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:21,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:22,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:23,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:54:23,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:23,862 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:54:23,863 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:54:23,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:23,912 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:54:24,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:54:24,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:54:24,808 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:54:24,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:25,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:26,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:27,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:28,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:29,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:29,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:30,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:31,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:32,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:33,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:34,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:35,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:35,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:36,985 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:37,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:38,986 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:39,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:54:39,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:54:40,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:41,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:41,224 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:42,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:42,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:54:42,906 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:54:42,906 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:54:42,968 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:54:43,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:43,259 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:54:44,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:45,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:46,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:46,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:47,158 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:48,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:49,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:50,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:50,662 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:54:51,349 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:51,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:52,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:53,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:54,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:54:54,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:54:54,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:55,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:56,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:57,185 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:54:57,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:58,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:54:59,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:00,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:01,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:02,355 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:02,521 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:55:02,522 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:55:02,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:55:02,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:02,570 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:55:02,729 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:55:03,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:04,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:05,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:06,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:07,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:07,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:08,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:09,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:55:09,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:55:09,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:10,605 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:11,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:12,606 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:13,261 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:13,632 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:14,607 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:15,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:16,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:17,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:18,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:18,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:19,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:20,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:20,663 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:55:21,309 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:55:21,310 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:55:21,310 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:55:21,353 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:55:21,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:22,211 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:55:22,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:23,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:23,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:24,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:55:24,217 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:55:24,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:25,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:26,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:27,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:28,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:28,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:29,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:30,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:31,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:32,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:33,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:33,895 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:34,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:35,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:36,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:37,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:38,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:39,050 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:39,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:55:39,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:55:39,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:40,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:41,620 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:42,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:43,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:44,114 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:44,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:45,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:46,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:47,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:48,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:49,161 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:49,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:50,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:50,665 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:55:51,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:52,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:53,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:54,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:55:54,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:55:54,273 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:54,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:55,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:56,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:57,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:58,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:55:59,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:55:59,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:00,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:01,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:02,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:03,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:04,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:04,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:05,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:06,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:07,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:08,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:09,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:56:09,219 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:56:09,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:09,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:10,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:10,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:56:10,775 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:56:10,775 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:56:10,821 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:56:11,353 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:56:11,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:12,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:13,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:14,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:14,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:15,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:16,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:17,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:18,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:19,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:20,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:20,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:20,666 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:56:21,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:22,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:23,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:24,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:56:24,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:56:24,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:25,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:25,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:26,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:27,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:28,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:29,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:56:29,562 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:56:29,562 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:56:29,624 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:56:29,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:29,775 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:56:30,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:30,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:31,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:32,641 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:33,642 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:34,642 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:35,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:36,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:36,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:37,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:38,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:39,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:56:39,219 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:56:39,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:40,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:41,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:41,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:42,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:43,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:44,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:45,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:46,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:47,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:47,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:48,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:49,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:56:49,070 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:56:49,070 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:56:49,117 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:56:49,261 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:56:49,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:50,668 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:56:50,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:51,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:52,754 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:52,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:53,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:54,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:56:54,219 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:56:54,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:55,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:56,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:57,798 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:56:57,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:58,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:56:59,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:00,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:01,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:02,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:02,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:03,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:04,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:05,408 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:57:05,409 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:57:05,410 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:57:05,447 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:57:05,585 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:57:05,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:06,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:07,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:08,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:08,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:09,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:57:09,427 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:57:09,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:10,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:11,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:12,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:13,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:13,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:14,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:15,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:16,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:17,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:18,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:18,903 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:19,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:20,669 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:57:20,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:21,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:22,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:23,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:57:23,002 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:57:23,002 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:57:23,044 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:57:23,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:24,038 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:57:24,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:24,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:57:24,427 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:57:24,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:25,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:26,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:27,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:28,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:29,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:29,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:30,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:31,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:32,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:33,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:34,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:35,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:35,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:36,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:37,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:38,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:39,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:57:39,427 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:57:39,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:40,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:40,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:41,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:57:41,161 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:57:41,162 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:57:41,211 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:57:41,417 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:57:41,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:42,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:43,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:44,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:45,362 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:45,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:46,909 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:47,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:48,910 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:50,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:50,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:50,670 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:57:51,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:52,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:53,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:54,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:54,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:57:54,460 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:57:55,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:56,125 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:56,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:57:57,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:58,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:59,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:57:59,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:57:59,822 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:57:59,822 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:57:59,868 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:58:00,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:00,899 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:58:01,126 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:01,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:02,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:03,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:04,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:05,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:06,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:07,112 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:07,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:08,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:09,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:09,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:58:09,427 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:58:10,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:11,133 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:12,133 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:13,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:13,133 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:14,133 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:15,179 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:16,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:17,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:18,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:18,557 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:19,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:19,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:58:19,477 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:58:19,478 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:58:19,530 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:58:20,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:20,360 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:58:20,672 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:58:21,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:22,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:23,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:23,702 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:24,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:24,427 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:58:24,428 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:58:25,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:26,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:27,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:28,257 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:29,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:29,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:30,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:31,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:32,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:33,258 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:34,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:34,761 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:35,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:36,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:37,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:37,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:58:37,433 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:58:37,433 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:58:37,486 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:58:37,717 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:58:38,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:39,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:39,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:58:39,429 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:58:40,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:40,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:41,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:42,263 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:43,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:44,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:45,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:45,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:46,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:47,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:48,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:49,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:50,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:50,673 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:58:50,674 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:51,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:52,265 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:53,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:54,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:54,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:58:54,428 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:58:55,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:56,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:56,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:58:56,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:58:56,745 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:58:56,746 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:58:56,798 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:58:57,235 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:58:57,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:58,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:58:59,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:00,329 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:01,330 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:01,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:02,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:03,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:04,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:05,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:06,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:06,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:07,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:08,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:09,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:09,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:59:09,429 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:59:10,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:11,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:12,121 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:12,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:13,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:14,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:15,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 13:59:15,022 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 13:59:15,023 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 13:59:15,072 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 13:59:15,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:15,631 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 13:59:16,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:17,208 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:17,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:18,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:19,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:20,335 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:20,674 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:59:21,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:22,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:22,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:23,335 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:24,335 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:24,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:59:24,469 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:59:25,335 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:26,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:27,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:27,395 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:28,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:29,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:30,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:31,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:32,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:32,399 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:33,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:34,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:35,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:36,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:37,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:37,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:38,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:39,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:39,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:59:39,457 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:59:40,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:41,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:42,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:42,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:43,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:44,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:45,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:46,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:47,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:47,658 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:48,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:49,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:50,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:50,675 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 13:59:51,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:52,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:52,683 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:53,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:54,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:54,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 13:59:54,429 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 13:59:55,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:56,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:57,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:57,755 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 13:59:58,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 13:59:59,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:00,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:01,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:02,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:02,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:03,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:04,272 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:00:04,275 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:00:04,275 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:00:04,324 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:00:04,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:04,768 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:00:05,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:06,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:07,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:07,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:08,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:09,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:09,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:00:09,429 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:00:10,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:11,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:12,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:13,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:13,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:14,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:15,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:16,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:17,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:18,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:18,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:19,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:20,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:20,677 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:00:21,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:22,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:22,648 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:00:22,650 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:00:22,650 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:00:22,697 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:00:23,248 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:00:23,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:24,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:24,419 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:24,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:00:24,460 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:00:25,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:26,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:27,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:28,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:29,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:29,485 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:30,354 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:31,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:32,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:33,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:34,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:35,003 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:35,548 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:36,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:37,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:38,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:39,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:00:39,430 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:00:39,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:40,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:40,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:41,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:41,912 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:00:41,913 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:00:41,914 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:00:41,965 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:00:42,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:42,669 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:00:43,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:44,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:45,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:45,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:46,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:47,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:48,553 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:49,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:50,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:50,678 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:00:50,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:51,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:52,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:53,792 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:54,429 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:00:54,430 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:00:54,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:55,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:56,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:00:56,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:57,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:58,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:00:59,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:00,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:01,379 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:01,933 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:02,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:01:02,205 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:01:02,206 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:01:02,280 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:01:02,934 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:03,151 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:01:03,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:05,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:06,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:06,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:07,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:08,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:09,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:09,476 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:01:09,477 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:01:10,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:11,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:12,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:12,156 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:13,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:14,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:15,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:16,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:17,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:17,477 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:18,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:19,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:20,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:20,679 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:01:20,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:01:20,686 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:01:20,686 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:01:20,727 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:01:21,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:21,591 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:01:22,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:22,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:23,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:24,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:24,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:01:24,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:01:25,066 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:26,119 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:27,119 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:28,119 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:28,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:29,119 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:30,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:31,154 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:32,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:33,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:33,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:34,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:35,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:36,155 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:37,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:38,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:39,084 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:39,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:39,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:01:39,505 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:01:39,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:01:39,859 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:01:39,859 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:01:39,901 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:01:39,979 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:01:40,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:41,159 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:42,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:43,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:44,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:44,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:45,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:46,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:47,160 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:48,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:49,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:50,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:50,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:50,680 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:01:51,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:52,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:53,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:54,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:54,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:01:54,505 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:01:55,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:56,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:56,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:01:57,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:58,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:01:58,308 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:01:58,309 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:01:58,310 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:01:58,359 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:01:58,465 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:01:59,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:00,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:01,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:01,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:02,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:03,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:04,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:05,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:06,259 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:06,659 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:07,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:08,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:09,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:09,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:02:09,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:02:10,467 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:11,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:12,152 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:12,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:13,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:14,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:15,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:15,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:02:15,697 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:02:15,697 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:02:15,746 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:02:15,852 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:02:16,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:17,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:17,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:18,599 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:19,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:20,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:20,682 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:02:21,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:22,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:23,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:23,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:24,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:02:24,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:02:24,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:25,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:26,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:27,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:28,262 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:28,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:29,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:30,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:31,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:32,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:33,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:33,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:34,380 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:02:34,381 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:02:34,382 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:02:34,438 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:02:34,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:35,339 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:02:35,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:36,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:37,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:38,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:38,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:39,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:02:39,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:02:39,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:40,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:41,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:42,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:43,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:43,943 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:44,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:45,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:46,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:47,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:48,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:49,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:49,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:50,683 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:02:50,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:51,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:52,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:53,216 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:02:53,217 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:02:53,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:02:53,277 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:02:53,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:53,775 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:02:54,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:02:54,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:02:54,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:02:54,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:55,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:56,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:57,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:58,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:59,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:02:59,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:00,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:01,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:02,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:03,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:04,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:05,384 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:05,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:06,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:07,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:08,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:09,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:03:09,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:03:09,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:10,384 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:10,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:11,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:03:11,826 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:03:11,826 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:03:11,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:11,892 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:03:12,157 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:03:12,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:13,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:14,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:15,385 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:15,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:16,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:17,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:18,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:19,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:20,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:20,691 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:03:20,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:21,835 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:22,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:23,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:24,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:03:24,506 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:03:24,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:25,393 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:25,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:26,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:27,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:28,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:29,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:30,536 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:30,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:31,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:32,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:33,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:34,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:35,549 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:35,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:36,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:37,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:38,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:39,506 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:03:39,507 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:03:39,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:40,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:40,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:41,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:42,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:43,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:44,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:45,717 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:45,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:46,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:47,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:48,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:49,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:50,686 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:03:50,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:50,935 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:51,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:52,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:53,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:54,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:03:54,507 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:03:54,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:55,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:56,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:03:56,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:57,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:58,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:03:59,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:00,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:00,987 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:04:00,989 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:04:00,989 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:04:01,031 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:04:01,245 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:04:01,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:02,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:02,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:03,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:04,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:05,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:06,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:07,777 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:07,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:08,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:09,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:04:09,507 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:04:09,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:10,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:11,843 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:12,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:13,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:13,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:14,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:15,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:16,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:17,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:18,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:18,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:04:18,545 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:04:18,545 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:04:18,596 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:04:18,668 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:04:18,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:19,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:20,687 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:04:20,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:22,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:23,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:23,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:24,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:24,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:04:24,507 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:04:25,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:26,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:27,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:28,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:29,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:29,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:30,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:31,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:32,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:33,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:34,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:35,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:35,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:36,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:37,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:38,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:38,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:04:38,333 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:04:38,333 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:04:38,398 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:04:39,150 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:04:39,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:39,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:04:39,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:04:40,180 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:40,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:41,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:42,276 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:43,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:44,277 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:45,283 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:45,519 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:46,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:47,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:48,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:49,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:50,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:50,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:50,688 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:04:51,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:52,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:53,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:54,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:54,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:04:54,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:04:55,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:55,960 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:04:56,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:04:56,013 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:04:56,014 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:04:56,061 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:04:56,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:56,561 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:04:57,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:58,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:04:59,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:00,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:01,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:01,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:02,290 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:03,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:04,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:05,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:06,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:06,611 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:07,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:08,291 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:09,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:09,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:05:09,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:05:10,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:11,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:12,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:12,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:13,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:14,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:05:14,314 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:05:14,314 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:05:14,374 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:05:14,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:15,013 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:05:15,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:16,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:17,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:17,482 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:18,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:19,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:20,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:20,689 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:05:21,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:22,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:22,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:23,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:24,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:24,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:05:24,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:05:25,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:26,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:27,416 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:28,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:28,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:29,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:30,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:31,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:31,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:05:31,765 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:05:31,766 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:05:31,826 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:05:32,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:32,478 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:05:33,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:33,911 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:34,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:35,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:36,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:37,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:38,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:39,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:39,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:05:39,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:05:39,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:40,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:41,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:42,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:43,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:44,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:45,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:45,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:46,582 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:47,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:48,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:49,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:50,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:05:50,102 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:05:50,102 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:05:50,140 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:05:50,141 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:50,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:50,690 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:05:50,901 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:05:51,622 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:52,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:53,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:54,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:05:54,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:05:54,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:55,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:55,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:05:56,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:57,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:58,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:05:59,896 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:00,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:00,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:01,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:02,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:03,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:04,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:05,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:05,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:06,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:07,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:08,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:09,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:06:09,297 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:06:09,297 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:06:09,314 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:06:09,335 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:06:09,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:06:09,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:06:09,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:10,349 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:06:10,751 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:10,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:11,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:12,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:13,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:14,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:15,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:15,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:16,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:18,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:19,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:20,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:20,692 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:06:20,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:21,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:22,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:23,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:24,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:24,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:06:24,508 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:06:25,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:26,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:26,533 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:27,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:28,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:06:28,053 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:06:28,054 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:06:28,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:28,089 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:06:28,792 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:06:29,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:30,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:31,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:31,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:32,062 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:33,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:34,063 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:35,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:36,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:36,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:37,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:38,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:39,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:39,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:06:39,516 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:06:40,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:41,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:42,071 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:42,222 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:43,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:44,363 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:45,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:46,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:47,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:47,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:06:47,298 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:06:47,298 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:06:47,353 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:06:47,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:48,181 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:06:48,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:49,364 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:50,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:50,693 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:06:51,365 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:52,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:52,556 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:53,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:54,437 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:54,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:06:54,513 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:06:55,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:56,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:57,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:58,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:06:58,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:06:59,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:00,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:01,741 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:02,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:03,540 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:03,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:04,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:05,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:06,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:07:06,218 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:07:06,218 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:07:06,281 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:07:06,599 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:07:06,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:07,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:08,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:08,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:09,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:07:09,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:07:09,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:10,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:11,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:12,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:13,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:13,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:14,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:15,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:16,763 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:17,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:18,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:18,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:19,764 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:20,694 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:07:20,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:21,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:22,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:23,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:23,908 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:24,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:07:24,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:07:24,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:25,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:26,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:27,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:28,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:28,979 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:29,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:30,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:31,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:32,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:33,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:34,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:34,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:35,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:36,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:37,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:38,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:39,309 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:39,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:07:39,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:07:39,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:40,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:41,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:42,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:43,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:44,480 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:44,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:45,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:46,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:47,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:48,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:49,507 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:49,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:50,695 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:07:50,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:51,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:52,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:53,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:54,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:07:54,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:07:54,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:07:54,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:55,294 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:07:55,295 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:07:55,296 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:07:55,402 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:07:55,729 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:07:55,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:56,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:57,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:58,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:07:59,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:00,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:00,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:01,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:02,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:03,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:04,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:05,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:05,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:06,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:07,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:08,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:09,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:08:09,515 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:08:09,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:10,774 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:10,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:11,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:12,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:13,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:14,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:08:14,458 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:08:14,458 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:08:14,501 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:08:14,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:15,142 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:08:15,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:15,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:16,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:17,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:18,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:19,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:20,697 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:08:20,790 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:20,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:21,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:22,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:23,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:24,514 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:08:24,515 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:08:24,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:25,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:25,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:26,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:27,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:28,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:29,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:30,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:30,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:31,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:32,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:33,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:08:33,666 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:08:33,666 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:08:33,724 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:08:33,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:34,566 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:08:34,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:35,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:36,791 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:36,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:37,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:38,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:39,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:08:39,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:08:39,837 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:41,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:42,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:42,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:43,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:44,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:45,225 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:46,226 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:47,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:48,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:48,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:49,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:50,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:50,698 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:08:51,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:52,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:08:52,089 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:08:52,089 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:08:52,131 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:08:52,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:52,903 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:08:53,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:54,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:08:54,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:54,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:08:54,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:08:55,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:56,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:57,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:58,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:08:59,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:00,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:00,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:01,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:02,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:03,301 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:04,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:05,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:05,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:06,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:07,306 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:08,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:09,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:09,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:09:09,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:09:10,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:10,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:11,028 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:09:11,029 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:09:11,030 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:09:11,078 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:09:11,308 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:09:11,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:12,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:13,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:14,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:15,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:15,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:16,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:17,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:18,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:19,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:20,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:20,699 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:09:20,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:21,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:22,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:23,542 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:24,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:24,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:09:24,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:09:25,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:26,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:26,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:27,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:28,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:09:28,521 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:09:28,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:09:28,559 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:09:28,600 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:28,715 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:09:29,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:30,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:31,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:31,601 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:32,602 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:33,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:34,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:35,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:36,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:37,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:37,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:38,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:39,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:39,726 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:09:39,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:09:40,692 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:41,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:42,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:43,163 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:43,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:44,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:45,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:46,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:47,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:48,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:48,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:09:48,353 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:09:48,354 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:09:48,391 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:09:48,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:49,129 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:09:49,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:50,700 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:09:50,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:51,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:52,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:53,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:53,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:54,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:09:54,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:09:54,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:55,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:56,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:57,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:58,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:09:58,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:09:59,779 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:00,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:01,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:02,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:03,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:04,366 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:04,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:05,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:06,428 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:10:06,429 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:10:06,430 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:10:06,463 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:10:06,562 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:10:06,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:07,780 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:08,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:09,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:10:09,727 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:10:09,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:09,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:10,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:11,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:12,781 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:13,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:14,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:15,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:15,782 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:16,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:17,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:19,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:20,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:20,594 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:20,701 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:10:21,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:22,043 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:23,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:23,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:10:23,726 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:10:23,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:10:23,783 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:10:23,914 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:10:24,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:24,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:10:24,728 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:10:25,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:25,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:26,044 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:27,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:28,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:29,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:30,045 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:31,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:31,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:32,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:33,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:34,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:35,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:36,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:36,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:37,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:38,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:39,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:39,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:10:39,769 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:10:40,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:41,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:41,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:41,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:10:41,626 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:10:41,626 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:10:41,689 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:10:42,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:42,331 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:10:43,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:44,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:45,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:46,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:46,421 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:47,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:48,049 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:49,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:50,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:50,703 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:10:51,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:52,157 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:52,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:53,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:54,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:54,729 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:10:54,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:10:55,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:56,190 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:57,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:57,233 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:10:58,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:59,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:10:59,640 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:10:59,642 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:10:59,642 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:10:59,691 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:10:59,723 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:11:00,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:01,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:02,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:02,310 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:03,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:04,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:05,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:06,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:07,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:07,358 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:08,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:09,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:09,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:11:09,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:11:10,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:11,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:12,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:12,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:13,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:14,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:15,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:16,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:17,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:17,579 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:18,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:19,196 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:20,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:20,704 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:11:21,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:22,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:22,652 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:23,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:24,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:24,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:11:24,730 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:11:25,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:26,197 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:27,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:27,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:28,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:29,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:30,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:31,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:32,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:32,996 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:33,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:34,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:35,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:36,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:37,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:38,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:38,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:39,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:39,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:11:39,731 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:11:40,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:41,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:42,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:43,092 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:43,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:44,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:45,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:46,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:47,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:48,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:48,226 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:49,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:11:49,049 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:11:49,050 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:11:49,088 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:11:49,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:49,863 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:11:50,201 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:50,705 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:11:51,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:52,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:53,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:53,532 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:54,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:54,730 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:11:54,731 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:11:55,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:56,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:57,203 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:58,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:11:58,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:11:59,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:00,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:01,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:02,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:03,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:04,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:04,656 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:05,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:06,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:07,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:12:07,269 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:12:07,270 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:12:07,324 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:12:07,446 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:12:07,463 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:08,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:09,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:09,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:12:09,731 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:12:09,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:10,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:11,623 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:12,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:13,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:14,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:15,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:15,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:16,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:17,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:18,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:19,624 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:20,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:20,706 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:12:20,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:21,625 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:22,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:23,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:24,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:24,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:12:24,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:12:25,711 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:25,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:26,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:12:26,397 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:12:26,398 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:12:26,433 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:12:26,711 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:26,920 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:12:27,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:28,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:29,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:30,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:30,959 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:31,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:32,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:33,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:34,712 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:35,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:36,236 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:36,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:37,728 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:38,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:39,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:39,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:12:39,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:12:40,713 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:41,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:41,714 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:42,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:43,772 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:44,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:45,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:12:45,425 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:12:45,426 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:12:45,525 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:12:45,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:46,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:46,375 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:12:46,776 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:48,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:49,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:50,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:50,717 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:12:51,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:51,237 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:52,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:53,127 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:54,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:54,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:12:54,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:12:55,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:56,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:56,387 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:12:57,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:58,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:12:59,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:00,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:01,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:02,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:02,128 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:03,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:04,108 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:13:04,109 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:13:04,110 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:13:04,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:04,157 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:13:04,833 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:13:05,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:06,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:07,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:07,148 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:08,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:09,129 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:09,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:13:09,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:13:10,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:11,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:12,130 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:12,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:13,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:14,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:15,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:16,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:17,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:17,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:18,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:19,202 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:20,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:20,709 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:13:21,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:21,645 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:13:21,646 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:13:21,646 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:13:21,698 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:13:22,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:22,231 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:13:22,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:23,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:24,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:24,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:13:24,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:13:25,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:26,205 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:27,206 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:28,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:28,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:29,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:30,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:31,446 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:32,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:33,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:34,107 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:34,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:35,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:36,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:37,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:38,447 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:39,217 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:39,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:39,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:13:39,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:13:39,885 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:13:39,886 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:13:39,887 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:13:39,931 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:13:40,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:40,658 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:13:41,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:42,460 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:43,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:44,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:45,077 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:45,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:46,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:47,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:48,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:49,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:50,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:50,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:50,710 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:13:51,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:52,567 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:53,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:54,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:54,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:13:54,732 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:13:55,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:56,061 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:13:56,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:57,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:58,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:13:59,328 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:13:59,330 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:13:59,330 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:13:59,377 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:13:59,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:00,085 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:14:00,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:01,064 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:01,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:02,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:03,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:04,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:05,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:06,313 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:06,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:07,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:08,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:09,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:14:09,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:14:09,736 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:10,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:11,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:12,245 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:12,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:13,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:14,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:15,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:16,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:17,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:14:17,006 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:14:17,006 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:14:17,047 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:14:17,492 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:14:17,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:18,048 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:18,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:19,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:20,711 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:14:20,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:21,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:22,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:23,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:23,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:24,732 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:14:24,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:14:24,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:25,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:26,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:27,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:28,803 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:28,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:29,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:30,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:31,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:32,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:33,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:34,589 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:34,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:35,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:36,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:37,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:14:37,190 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:14:37,190 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:14:37,228 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:14:37,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:37,994 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:14:38,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:39,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:14:39,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:14:39,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:39,881 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:40,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:41,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:42,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:43,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:44,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:45,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:45,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:46,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:47,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:48,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:49,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:50,713 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:14:50,714 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:50,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:51,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:52,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:53,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:54,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:14:54,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:14:54,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:55,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:14:55,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:56,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:14:56,334 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:14:56,334 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:14:56,371 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:14:56,490 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:14:56,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:57,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:58,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:14:59,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:00,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:00,897 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:01,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:02,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:03,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:04,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:05,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:05,988 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:06,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:07,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:08,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:09,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:15:09,733 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:15:09,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:10,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:11,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:11,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:12,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:13,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:14,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:15,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:16,089 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:16,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:17,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:18,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:19,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:20,714 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:15:20,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:21,173 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:21,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:22,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:23,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:24,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:15:24,734 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:15:24,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:25,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:26,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:26,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:27,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:28,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:29,870 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:30,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:31,315 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:31,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:32,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:33,871 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:34,872 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:35,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:36,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:36,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:37,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:38,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:39,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:15:39,734 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:15:39,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:40,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:41,359 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:41,873 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:42,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:43,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:44,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:45,246 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:15:45,248 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:15:45,248 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:15:45,293 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:15:45,709 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:15:45,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:46,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:46,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:47,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:48,874 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:49,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:50,716 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:15:50,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:51,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:52,316 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:52,875 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:53,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:54,733 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:15:54,734 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:15:54,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:55,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:56,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:57,317 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:15:57,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:58,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:15:59,876 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:00,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:01,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:02,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:02,950 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:03,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:04,032 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:16:04,033 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:16:04,033 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:16:04,074 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:16:04,105 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:16:04,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:05,877 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:06,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:07,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:08,229 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:08,879 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:09,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:16:09,734 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:16:09,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:10,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:11,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:12,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:13,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:13,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:14,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:16,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:17,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:18,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:19,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:19,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:20,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:20,716 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:16:21,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:22,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:16:22,146 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:16:22,146 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:16:22,200 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:16:22,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:22,567 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:16:23,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:24,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:24,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:16:24,734 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:16:24,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:25,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:26,369 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:27,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:28,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:29,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:30,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:30,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:31,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:32,370 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:33,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:34,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:35,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:36,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:36,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:37,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:38,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:39,371 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:39,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:16:39,735 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:16:40,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:40,724 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:16:40,726 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:16:40,726 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:16:40,766 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:16:41,007 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:16:41,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:41,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:42,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:43,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:44,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:45,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:46,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:46,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:47,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:48,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:49,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:50,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:50,724 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:16:51,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:51,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:52,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:53,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:54,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:54,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:16:54,735 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:16:55,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:56,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:57,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:16:57,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:58,374 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:59,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:16:59,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:16:59,406 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:16:59,406 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:16:59,454 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:16:59,624 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:17:00,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:01,375 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:02,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:02,376 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:03,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:04,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:05,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:06,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:07,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:07,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:08,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:09,438 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:09,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:17:09,735 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:17:10,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:11,468 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:12,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:13,156 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:13,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:14,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:15,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:16,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:17,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:18,410 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:18,452 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:17:18,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:18,454 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:17:18,454 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:17:18,506 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:17:19,027 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:17:19,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:20,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:20,719 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:17:21,472 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:22,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:23,431 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:23,551 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:24,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:24,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:17:24,735 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:17:25,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:26,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:27,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:28,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:28,727 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:29,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:30,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:31,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:32,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:33,578 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:34,181 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:34,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:35,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:36,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:37,088 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:17:37,090 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:17:37,090 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:17:37,132 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:17:37,436 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:17:37,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:38,660 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:39,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:39,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:17:39,830 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:17:39,954 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:40,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:41,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:42,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:43,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:44,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:45,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:45,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:46,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:47,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:48,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:49,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:50,720 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:17:50,721 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:50,905 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:51,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:52,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:53,906 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:54,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:17:54,806 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:17:54,806 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:17:54,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:17:54,870 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:17:54,870 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:17:55,041 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:55,862 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:17:55,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:17:56,041 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:57,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:58,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:17:59,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:00,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:01,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:01,182 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:02,042 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:03,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:04,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:05,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:06,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:06,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:07,067 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:08,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:09,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:09,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:18:09,830 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:18:10,068 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:11,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:12,150 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:12,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:12,637 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:18:12,639 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:18:12,639 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:18:12,691 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:18:13,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:13,258 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:18:14,151 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:15,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:16,574 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:17,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:17,973 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:18,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:19,575 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:20,721 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:18:20,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:21,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:22,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:23,198 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:23,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:24,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:24,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:18:24,830 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:18:25,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:26,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:27,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:28,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:28,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:29,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:30,784 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:31,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:18:31,678 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:18:31,678 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:18:31,711 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:18:31,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:32,687 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:18:32,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:33,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:34,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:34,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:35,787 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:36,787 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:37,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:38,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:39,559 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:39,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:39,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:18:39,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:18:40,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:41,788 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:42,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:43,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:44,759 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:44,800 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:45,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:46,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:47,796 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:48,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:49,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:50,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:50,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:18:50,630 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:18:50,631 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:18:50,673 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:18:50,723 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:18:50,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:51,121 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:18:51,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:52,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:53,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:54,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:18:54,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:18:54,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:55,055 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:18:55,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:56,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:57,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:58,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:18:59,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:00,145 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:00,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:01,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:02,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:03,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:04,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:05,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:05,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:06,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:07,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:08,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:09,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:19:09,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:19:09,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:10,384 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:10,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:11,861 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:12,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:13,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:14,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:15,481 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:15,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:16,862 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:17,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:18,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:19,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:20,498 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:20,724 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:19:20,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:21,863 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:22,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:23,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:24,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:19:24,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:19:24,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:25,571 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:25,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:26,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:27,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:28,864 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:29,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:30,629 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:30,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:31,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:32,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:33,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:34,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:35,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:35,865 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:36,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:37,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:38,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:39,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:19:39,831 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:19:39,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:40,037 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:19:40,040 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:19:40,040 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:19:40,092 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:19:40,260 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:19:40,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:41,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:41,884 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:42,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:43,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:44,866 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:45,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:46,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:46,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:47,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:48,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:49,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:50,726 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:19:50,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:51,406 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:51,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:52,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:53,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:54,836 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:19:54,836 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:19:54,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:55,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:56,577 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:19:56,981 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:57,982 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:58,512 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:19:58,513 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:19:58,514 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:19:58,571 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:19:58,668 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:19:58,982 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:19:59,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:00,982 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:01,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:02,315 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:02,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:03,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:04,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:05,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:06,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:07,405 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:07,983 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:09,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:09,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:20:09,832 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:20:10,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:11,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:12,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:13,090 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:13,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:14,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:15,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:16,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:17,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:18,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:18,243 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:18,284 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:20:18,286 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:20:18,286 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:20:18,338 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:20:19,136 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:20:19,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:20,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:20,727 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:20:21,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:22,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:23,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:23,621 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:24,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:24,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:20:24,833 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:20:25,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:26,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:27,194 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:28,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:28,899 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:29,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:30,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:31,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:32,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:33,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:34,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:34,783 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:35,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:35,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:20:35,490 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:20:35,490 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:20:35,526 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:20:36,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:36,452 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:20:37,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:38,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:39,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:39,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:20:39,832 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:20:39,890 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:40,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:41,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:42,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:43,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:44,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:45,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:45,249 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:46,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:47,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:48,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:49,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:50,040 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:50,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:50,735 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:20:51,250 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:52,251 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:53,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:53,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:20:53,554 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:20:53,554 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:20:53,608 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:20:53,866 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:20:54,381 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:54,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:20:54,833 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:20:55,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:20:55,382 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:56,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:57,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:58,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:20:59,384 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:00,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:00,566 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:01,383 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:02,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:03,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:04,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:05,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:06,234 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:06,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:07,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:08,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:09,401 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:09,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:21:09,833 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:21:10,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:11,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:11,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:12,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:21:12,241 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:21:12,242 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:21:12,298 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:21:12,299 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:21:12,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:13,309 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:21:13,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:14,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:15,402 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:16,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:16,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:17,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:18,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:19,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:20,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:20,730 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:21:21,411 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:21,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:22,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:23,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:24,489 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:24,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:21:24,833 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:21:25,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:26,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:26,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:27,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:28,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:29,490 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:30,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:31,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:31,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:32,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:21:32,022 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:21:32,022 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:21:32,060 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:21:32,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:32,801 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:21:33,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:34,491 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:35,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:36,492 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:37,047 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:37,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:38,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:39,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:39,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:21:39,833 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:21:40,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:41,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:42,414 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:42,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:43,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:44,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:45,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:46,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:47,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:47,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:48,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:49,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:50,116 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:21:50,118 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:21:50,118 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:21:50,182 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:21:50,284 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:21:50,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:50,731 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:21:51,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:52,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:53,074 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:53,693 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:54,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:54,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:21:54,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:21:55,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:56,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:57,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:58,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:21:58,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:21:59,844 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:00,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:01,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:02,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:03,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:03,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:04,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:05,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:06,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:07,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:08,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:08,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:09,192 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:22:09,194 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:22:09,194 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:22:09,248 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:22:09,657 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:22:09,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:22:09,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:22:09,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:10,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:11,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:12,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:13,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:14,065 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:14,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:15,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:16,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:17,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:18,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:19,448 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:19,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:20,740 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:22:20,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:21,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:22,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:23,964 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:24,554 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:24,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:22:24,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:22:24,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:25,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:26,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:27,552 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:22:27,554 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:22:27,554 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:22:27,591 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:22:27,963 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:28,051 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:22:28,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:29,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:30,199 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:30,975 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:31,975 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:32,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:33,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:35,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:36,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:36,154 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:37,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:38,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:39,002 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:39,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:22:39,846 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:22:40,037 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:41,037 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:41,698 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:42,037 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:43,038 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:44,038 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:45,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:46,163 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:46,292 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:22:46,294 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:22:46,294 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:22:46,334 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:22:46,411 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:22:46,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:47,163 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:48,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:49,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:50,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:50,734 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:22:51,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:51,765 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:52,164 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:53,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:54,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:54,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:22:54,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:22:55,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:56,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:56,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:22:57,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:58,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:22:59,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:00,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:01,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:01,778 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:02,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:03,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:04,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:05,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:06,166 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:06,786 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:07,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:08,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:09,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:09,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:23:09,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:23:10,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:11,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:11,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:12,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:13,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:14,167 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:15,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:16,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:16,893 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:17,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:18,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:19,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:20,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:20,735 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:23:21,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:21,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:22,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:23,168 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:24,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:24,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:23:24,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:23:25,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:26,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:27,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:27,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:28,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:29,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:30,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:31,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:32,165 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:32,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:33,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:34,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:35,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:36,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:36,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:23:36,205 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:23:36,205 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:23:36,249 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:23:36,593 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:23:37,170 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:37,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:38,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:39,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:39,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:23:39,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:23:40,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:41,174 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:42,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:43,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:43,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:44,171 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:45,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:46,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:47,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:48,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:49,087 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:49,172 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:50,227 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:50,737 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:23:51,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:52,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:53,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:54,228 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:54,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:23:54,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:23:55,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:23:55,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:55,892 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:23:55,894 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:23:55,894 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:23:55,935 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:23:56,079 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:23:56,403 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:57,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:58,404 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:23:59,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:00,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:00,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:01,425 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:02,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:03,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:04,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:05,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:06,122 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:06,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:07,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:08,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:09,426 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:09,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:24:09,848 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:24:10,432 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:11,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:11,634 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:12,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:13,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:14,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:14,508 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:24:14,509 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:24:14,510 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:24:14,543 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:24:15,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:15,529 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:24:16,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:16,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:17,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:18,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:19,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:20,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:20,738 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:24:21,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:22,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:22,591 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:23,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:24,439 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:24,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:24:24,847 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:24:25,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:26,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:27,440 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:27,775 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:28,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:29,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:30,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:31,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:32,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:33,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:33,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:34,268 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:24:34,269 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:24:34,270 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:24:34,320 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:24:34,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:34,952 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:24:35,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:36,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:37,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:38,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:38,927 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:39,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:39,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:24:39,848 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:24:40,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:41,442 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:42,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:43,443 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:44,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:44,878 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:45,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:46,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:47,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:48,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:49,677 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:50,452 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:50,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:50,739 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:24:51,678 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:51,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:24:51,746 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:24:51,746 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:24:51,813 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:24:52,394 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:24:52,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:53,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:54,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:54,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:24:54,848 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:24:55,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:55,990 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:24:56,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:57,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:58,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:24:59,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:00,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:01,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:01,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:02,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:03,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:04,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:05,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:06,907 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:06,948 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:07,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:08,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:09,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:25:09,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:25:09,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:10,676 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:25:10,677 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:25:10,678 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:25:10,729 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:25:10,784 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:25:11,242 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:11,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:12,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:13,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:14,343 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:15,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:16,356 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:16,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:17,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:18,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:19,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:20,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:20,740 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:25:21,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:21,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:22,350 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:23,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:24,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:24,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:25:24,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:25:25,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:26,351 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:27,352 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:27,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:28,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:29,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:30,240 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:25:30,241 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:25:30,242 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:25:30,318 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:25:30,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:31,199 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:25:31,449 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:32,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:32,929 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:33,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:34,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:35,464 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:36,450 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:37,451 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:38,451 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:38,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:39,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:39,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:25:39,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:25:40,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:41,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:42,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:43,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:44,176 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:44,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:45,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:46,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:47,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:48,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:48,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:25:48,630 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:25:48,630 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:25:48,683 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:25:49,454 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:49,586 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:25:49,684 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:50,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:50,742 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:25:51,455 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:52,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:53,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:54,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:54,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:25:54,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:25:54,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:25:55,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:56,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:57,457 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:58,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:25:59,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:00,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:00,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:01,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:02,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:03,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:04,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:05,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:06,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:06,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:07,304 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:26:07,305 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:26:07,306 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:26:07,367 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:26:07,691 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:08,026 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:26:08,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:09,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:09,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:26:09,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:26:10,699 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:11,700 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:11,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:12,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:13,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:14,731 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:15,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:16,804 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:16,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:17,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:18,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:19,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:20,750 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:26:20,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:21,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:22,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:22,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:23,805 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:24,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:24,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:26:24,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:26:25,254 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:26:25,256 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:26:25,256 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:26:25,318 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:26:25,410 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:26:25,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:26,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:27,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:27,937 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:28,806 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:29,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:30,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:31,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:32,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:33,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:33,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:34,807 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:35,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:36,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:37,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:38,808 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:39,260 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:39,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:39,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:26:39,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:26:40,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:41,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:42,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:43,809 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:44,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:26:44,026 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:26:44,026 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:26:44,073 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:26:44,342 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:44,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:44,856 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:26:45,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:46,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:47,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:48,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:49,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:49,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:50,744 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:26:50,810 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:51,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:52,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:53,811 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:54,430 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:54,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:54,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:26:54,849 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:26:55,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:56,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:57,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:58,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:26:59,547 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:26:59,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:00,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:01,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:02,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:03,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:04,568 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:04,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:05,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:06,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:07,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:08,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:09,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:09,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:09,849 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:27:09,850 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:27:10,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:11,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:12,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:13,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:14,626 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:14,814 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:15,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:16,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:17,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:18,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:19,657 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:19,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:20,746 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:27:20,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:21,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:22,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:23,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:24,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:24,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:24,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:27:24,850 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:27:25,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:26,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:27,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:28,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:29,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:29,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:30,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:31,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:32,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:33,545 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:27:33,547 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:27:33,547 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:27:33,595 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:27:33,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:34,067 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:27:34,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:35,392 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:35,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:36,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:37,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:38,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:39,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:39,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:27:39,850 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:27:40,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:40,998 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:41,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:42,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:43,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:44,841 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:45,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:46,163 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:46,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:47,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:48,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:49,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:50,747 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:27:50,842 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:51,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:51,994 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:52,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:52,980 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:27:52,982 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:27:52,982 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:27:53,015 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:27:53,519 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:27:53,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:54,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:54,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:27:54,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:27:55,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:56,944 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:57,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:57,995 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:27:58,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:27:59,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:00,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:01,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:02,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:03,213 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:03,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:04,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:05,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:06,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:07,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:08,747 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:08,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:09,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:28:09,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:28:09,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:10,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:11,252 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:28:11,253 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:28:11,254 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:28:11,304 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:28:11,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:11,949 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:28:12,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:13,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:13,966 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:14,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:15,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:16,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:17,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:18,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:19,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:19,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:20,748 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:28:20,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:21,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:22,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:23,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:24,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:24,850 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:28:24,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:28:24,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:25,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:27,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:28,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:28,968 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:28:28,969 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:28:28,969 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:28:29,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:29,038 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:28:29,375 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:28:30,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:30,039 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:31,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:32,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:33,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:34,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:35,021 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:35,453 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:36,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:37,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:38,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:39,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:39,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:28:39,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:28:40,022 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:40,904 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:41,023 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:42,023 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:43,023 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:44,023 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:45,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:46,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:46,356 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:46,396 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:28:46,397 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:28:46,398 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:28:46,472 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:28:46,729 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:28:47,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:48,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:49,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:50,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:50,749 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:28:51,024 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:51,378 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:52,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:53,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:54,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:54,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:28:54,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:28:55,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:56,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:56,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:28:57,025 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:58,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:28:59,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:00,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:01,026 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:02,178 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:02,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:03,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:04,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:04,976 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:29:04,977 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:29:04,978 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:29:05,015 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:29:05,178 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:29:05,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:06,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:07,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:07,266 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:08,267 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:09,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:09,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:29:09,852 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:29:10,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:11,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:12,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:12,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:13,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:14,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:15,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:16,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:17,186 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:17,278 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:18,279 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:19,308 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:20,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:20,751 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:29:21,280 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:22,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:22,942 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:22,984 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:29:22,985 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:29:22,986 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:29:23,052 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:29:23,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:23,556 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:29:24,495 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:24,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:29:24,851 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:29:25,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:26,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:27,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:28,187 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:28,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:29,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:30,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:31,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:32,496 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:33,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:33,686 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:34,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:35,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:36,497 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:37,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:38,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:39,001 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:39,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:39,851 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:29:39,852 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:29:40,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:41,388 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:29:41,390 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:29:41,390 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:29:41,440 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:29:41,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:41,993 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:29:42,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:43,544 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:44,502 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:44,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:45,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:46,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:47,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:48,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:49,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:50,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:50,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:50,752 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:29:51,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:52,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:53,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:54,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:54,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:29:54,852 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:29:55,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:55,952 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:29:56,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:57,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:58,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:29:59,400 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:29:59,402 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:29:59,402 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:29:59,463 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:29:59,518 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:00,417 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:30:00,519 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:01,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:01,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:02,663 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:03,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:04,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:05,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:06,664 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:06,773 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:07,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:08,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:09,812 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:09,855 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:30:09,856 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:30:10,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:11,813 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:12,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:12,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:13,816 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:14,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:15,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:16,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:17,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:17,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:30:17,521 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:30:17,522 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:30:17,560 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:30:17,739 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:30:17,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:18,817 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:19,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:20,753 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:30:20,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:21,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:22,188 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:22,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:23,818 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:24,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:24,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:30:24,856 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:30:25,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:26,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:27,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:27,819 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:28,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:29,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:30,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:31,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:32,189 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:32,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:33,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:34,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:35,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:36,000 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:30:36,001 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:30:36,002 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:30:36,045 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:30:36,195 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:30:36,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:37,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:37,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:38,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:39,821 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:39,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:30:39,857 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:30:40,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:41,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:42,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:42,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:43,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:44,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:45,822 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:46,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:47,456 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:47,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:48,823 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:49,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:50,755 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:30:50,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:51,824 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:52,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:52,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:53,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:54,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:54,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:30:54,856 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:30:55,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:56,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:57,648 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:30:57,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:58,825 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:30:59,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:00,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:01,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:02,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:02,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:03,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:04,826 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:05,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:06,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:07,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:08,004 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:08,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:09,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:09,856 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:31:09,856 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:31:10,827 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:11,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:12,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:13,005 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:13,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:14,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:15,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:16,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:17,828 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:18,046 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:18,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:19,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:20,756 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:31:20,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:21,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:22,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:23,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:23,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:24,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:24,857 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:31:24,857 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:31:25,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:31:25,257 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:31:25,257 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:31:25,296 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:31:25,377 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:31:25,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:26,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:27,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:28,191 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:28,830 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:29,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:30,860 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:31,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:32,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:33,270 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:33,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:34,831 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:35,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:36,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:37,832 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:38,612 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:38,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:39,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:39,868 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:31:39,869 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:31:40,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:41,833 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:42,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:43,076 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:31:43,078 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:31:43,078 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:31:43,122 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:31:43,809 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:31:43,839 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:44,123 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:44,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:45,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:46,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:47,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:48,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:49,785 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:49,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:50,757 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:31:50,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:51,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:52,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:53,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:54,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:31:54,858 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:31:54,965 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:55,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:31:55,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:56,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:57,977 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:31:59,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:00,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:00,279 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:01,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:02,052 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:32:02,054 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:32:02,054 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:32:02,093 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:32:02,144 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:02,190 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:32:03,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:04,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:05,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:05,505 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:06,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:07,285 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:08,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:09,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:09,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:32:09,858 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:32:10,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:10,734 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:11,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:12,286 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:13,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:14,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:15,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:16,035 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:16,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:17,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:18,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:19,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:19,668 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:32:19,669 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:32:19,670 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:32:19,704 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:32:20,289 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:20,618 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:32:20,758 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:32:21,325 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:21,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:22,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:23,335 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:24,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:24,880 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:32:24,881 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:32:25,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:26,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:27,193 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:27,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:28,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:29,336 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:30,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:31,337 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:32,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:32,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:33,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:34,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:35,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:36,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:37,036 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:32:37,038 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:32:37,038 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:32:37,091 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:32:37,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:37,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:38,062 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:32:38,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:39,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:39,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:32:39,859 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:32:40,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:41,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:42,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:42,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:43,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:44,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:45,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:46,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:47,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:48,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:48,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:49,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:50,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:50,760 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:32:51,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:52,340 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:53,341 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:54,300 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:32:54,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:54,858 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:32:54,859 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:32:54,991 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:32:54,993 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:32:54,993 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:32:55,031 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:32:55,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:55,453 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:32:56,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:57,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:58,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:59,344 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:32:59,474 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:00,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:01,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:02,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:03,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:04,345 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:05,058 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:05,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:06,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:07,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:08,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:09,346 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:09,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:33:09,859 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:33:10,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:10,588 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:11,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:12,264 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:33:12,266 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:33:12,266 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:33:12,329 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:33:12,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:12,883 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:33:13,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:14,347 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:15,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:15,947 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:16,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:17,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:18,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:19,348 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:20,373 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:20,761 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:33:21,372 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:21,762 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:22,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:23,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:24,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:24,859 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:33:24,859 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:33:25,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:26,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:27,075 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:27,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:28,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:29,527 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:30,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:31,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:31,716 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:33:31,718 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:33:31,718 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:33:31,756 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:33:32,316 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:33:32,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:32,528 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:33,529 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:34,529 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:35,529 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:36,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:37,413 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:37,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:38,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:39,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:39,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:33:39,889 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:33:40,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:41,531 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:42,530 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:42,888 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:43,531 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:44,535 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:45,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:46,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:47,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:48,368 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:48,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:49,597 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:50,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:33:50,125 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:33:50,126 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:33:50,178 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:33:50,597 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:50,762 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:33:50,765 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:33:51,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:52,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:53,513 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:53,671 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:54,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:54,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:33:54,889 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:33:55,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:56,672 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:57,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:58,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:33:58,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:33:59,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:00,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:01,673 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:02,703 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:03,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:04,244 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:04,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:05,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:06,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:07,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:08,200 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:34:08,201 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:34:08,201 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:34:08,237 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:34:08,246 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:34:08,704 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:09,247 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:09,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:09,889 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:34:09,890 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:34:10,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:11,705 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:12,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:13,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:14,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:15,169 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:15,707 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:16,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:17,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:18,708 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:19,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:20,319 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:20,763 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:34:20,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:21,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:22,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:23,853 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:24,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:24,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:34:24,914 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:34:25,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:26,085 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:26,412 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:34:26,414 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:34:26,414 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:34:26,470 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:34:26,655 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:34:26,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:27,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:28,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:29,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:30,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:31,156 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:31,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:32,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:33,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:34,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:35,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:36,232 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:36,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:37,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:38,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:39,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:34:39,914 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:34:39,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:40,916 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:41,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:41,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:42,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:43,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:44,917 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:45,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:46,377 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:46,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:47,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:48,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:49,918 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:50,765 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:34:50,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:51,529 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:51,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:52,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:53,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:54,914 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:34:54,915 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:34:54,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:55,919 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:56,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:34:56,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:57,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:58,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:34:59,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:00,920 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:01,627 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:01,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:02,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:03,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:04,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:05,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:06,689 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:06,921 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:07,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:08,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:09,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:35:09,915 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:35:09,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:10,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:11,852 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:11,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:12,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:13,922 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:14,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:15,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:16,034 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:35:16,036 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:35:16,037 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:35:16,096 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:35:16,746 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:35:16,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:17,097 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:17,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:18,923 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:19,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:20,766 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:35:20,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:21,924 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:22,214 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:23,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:24,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:24,928 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:35:24,929 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:35:25,081 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:26,082 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:27,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:27,419 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:28,099 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:29,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:30,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:31,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:32,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:32,488 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:33,120 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:35:33,121 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:33,123 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:35:33,123 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:35:33,191 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:35:34,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:34,180 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:35:35,100 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:36,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:37,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:37,515 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:38,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:39,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:39,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:35:39,916 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:35:40,101 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:41,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:42,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:42,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:43,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:44,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:45,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:46,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:47,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:48,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:48,241 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:49,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:50,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:50,768 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:35:51,103 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:51,669 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:35:51,670 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:35:51,670 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:35:51,711 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:35:52,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:52,551 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:35:53,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:54,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:54,235 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:35:54,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:35:54,917 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:35:55,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:56,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:57,104 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:58,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:59,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:35:59,953 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:00,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:01,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:02,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:03,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:04,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:05,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:05,424 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:06,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:07,140 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:08,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:09,114 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:09,360 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:36:09,362 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:36:09,362 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:36:09,400 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:36:09,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:36:09,916 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:36:09,954 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:36:10,114 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:10,867 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:11,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:12,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:13,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:14,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:15,287 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:16,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:16,421 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:17,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:18,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:19,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:20,288 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:20,769 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:36:21,330 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:21,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:22,330 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:23,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:24,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:24,915 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:36:24,916 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:36:25,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:26,331 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:27,256 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:27,296 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:36:27,297 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:36:27,298 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:36:27,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:27,334 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:36:27,339 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:36:28,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:28,349 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:36:29,332 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:30,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:31,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:32,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:32,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:33,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:34,333 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:35,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:36,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:37,334 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:37,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:38,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:39,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:40,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:36:40,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:36:40,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:41,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:42,433 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:42,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:43,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:44,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:44,593 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:36:44,594 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:36:44,595 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:36:44,636 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:36:44,797 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:36:45,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:46,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:47,434 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:47,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:48,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:49,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:50,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:50,770 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:36:51,562 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:52,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:52,561 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:53,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:54,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:55,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:36:55,093 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:36:55,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:56,569 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:57,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:58,558 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:36:58,570 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:36:59,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:00,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:01,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:02,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:03,212 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:37:03,214 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:37:03,214 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:37:03,247 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:37:03,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:04,230 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:37:04,248 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:04,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:05,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:06,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:07,614 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:08,615 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:09,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:10,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:10,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:37:10,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:37:10,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:11,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:12,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:13,616 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:14,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:15,102 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:15,617 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:16,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:17,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:18,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:19,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:20,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:20,710 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:20,772 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:37:21,618 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:22,008 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:37:22,009 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:37:22,010 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:37:22,065 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:37:22,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:22,668 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:37:23,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:24,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:25,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:37:25,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:37:25,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:26,613 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:26,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:27,619 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:28,735 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:29,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:30,736 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:31,736 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:31,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:32,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:33,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:34,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:35,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:36,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:37,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:37,737 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:38,752 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:39,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:40,093 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:37:40,094 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:37:40,137 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:37:40,201 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:37:40,201 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:37:40,236 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:37:40,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:41,116 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:37:41,738 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:42,560 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:42,742 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:43,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:44,739 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:45,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:46,740 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:47,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:47,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:48,743 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:49,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:50,744 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:50,780 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:37:51,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:52,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:53,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:53,834 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:54,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:55,132 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:37:55,133 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:37:55,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:56,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:57,840 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:58,555 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:37:58,596 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:37:58,598 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:37:58,598 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:37:58,643 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:37:58,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:37:59,531 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:37:59,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:00,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:01,845 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:02,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:03,633 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:03,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:04,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:05,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:06,846 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:07,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:08,745 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:08,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:09,847 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:10,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:38:10,095 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:38:10,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:11,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:12,848 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:14,008 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:14,679 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:15,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:15,441 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:38:15,442 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:38:15,443 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:38:15,480 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:38:15,920 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:38:16,008 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:17,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:18,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:19,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:19,690 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:20,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:20,774 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:38:21,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:22,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:23,009 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:24,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:24,815 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:25,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:25,094 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:38:25,095 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:38:26,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:27,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:28,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:29,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:29,820 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:30,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:31,010 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:32,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:33,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:34,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:34,974 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:35,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:36,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:37,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:38,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:39,011 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:40,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:40,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:38:40,095 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:38:40,218 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:41,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:42,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:43,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:44,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:45,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:45,255 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:46,012 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:47,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:48,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:49,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:50,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:50,312 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:50,782 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:38:51,013 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:52,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:53,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:54,014 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:55,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:55,124 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:38:55,125 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:38:55,461 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:38:56,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:57,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:58,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:38:59,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:00,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:00,478 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:01,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:02,015 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:03,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:04,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:04,869 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:39:04,871 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:39:04,871 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:04,935 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:05,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:05,062 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:39:05,936 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:06,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:07,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:08,016 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:09,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:10,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:10,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:39:10,096 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:39:11,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:11,195 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:12,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:13,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:14,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:15,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:16,017 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:16,204 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:17,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:18,056 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:19,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:20,018 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:20,777 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:39:21,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:21,665 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:22,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:23,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:23,628 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:39:23,629 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:39:23,630 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:23,670 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:24,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:24,497 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:39:25,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:25,095 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:39:25,095 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:39:26,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:26,970 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:27,020 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:28,019 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:29,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:30,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:31,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:32,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:32,706 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:33,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:34,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:35,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:36,105 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:37,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:37,957 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:38,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:39,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:40,096 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: stop_status 2024-06-15 14:39:40,096 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: stop_status 2024-06-15 14:39:40,136 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:41,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:41,838 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: partial_history 2024-06-15 14:39:41,839 DEBUG SenderThread:2088494 [sender.py:send():379] send: telemetry 2024-06-15 14:39:41,840 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:41,886 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:41,899 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:41,949 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:41,949 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:41,985 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:41,985 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:42,024 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:42,025 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:42,070 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:42,070 DEBUG SenderThread:2088494 [sender.py:send():379] send: history 2024-06-15 14:39:42,071 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: summary_record 2024-06-15 14:39:42,106 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:42,111 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:42,298 DEBUG SenderThread:2088494 [sender.py:send():379] send: exit 2024-06-15 14:39:42,298 INFO SenderThread:2088494 [sender.py:send_exit():586] handling exit code: 0 2024-06-15 14:39:42,298 INFO SenderThread:2088494 [sender.py:send_exit():588] handling runtime: 10462 2024-06-15 14:39:42,337 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:42,337 INFO SenderThread:2088494 [sender.py:send_exit():594] send defer 2024-06-15 14:39:42,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,338 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 0 2024-06-15 14:39:42,338 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,338 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 0 2024-06-15 14:39:42,338 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 1 2024-06-15 14:39:42,338 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,339 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 1 2024-06-15 14:39:42,339 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,339 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 1 2024-06-15 14:39:42,339 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 2 2024-06-15 14:39:42,339 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,339 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 2 2024-06-15 14:39:42,339 INFO HandlerThread:2088494 [system_monitor.py:finish():203] Stopping system monitor 2024-06-15 14:39:42,340 DEBUG SystemMonitor:2088494 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-06-15 14:39:42,340 DEBUG SystemMonitor:2088494 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-06-15 14:39:42,342 INFO HandlerThread:2088494 [interfaces.py:finish():200] Joined cpu monitor 2024-06-15 14:39:42,342 INFO HandlerThread:2088494 [interfaces.py:finish():200] Joined disk monitor 2024-06-15 14:39:42,458 INFO HandlerThread:2088494 [interfaces.py:finish():200] Joined gpu monitor 2024-06-15 14:39:42,459 INFO HandlerThread:2088494 [interfaces.py:finish():200] Joined memory monitor 2024-06-15 14:39:42,459 INFO HandlerThread:2088494 [interfaces.py:finish():200] Joined network monitor 2024-06-15 14:39:42,459 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,459 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 2 2024-06-15 14:39:42,459 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 3 2024-06-15 14:39:42,459 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,459 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 3 2024-06-15 14:39:42,469 DEBUG SenderThread:2088494 [sender.py:send():379] send: stats 2024-06-15 14:39:42,470 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,470 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 3 2024-06-15 14:39:42,470 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 4 2024-06-15 14:39:42,470 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,470 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 4 2024-06-15 14:39:42,470 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,470 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 4 2024-06-15 14:39:42,470 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 5 2024-06-15 14:39:42,471 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,471 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 5 2024-06-15 14:39:42,471 DEBUG SenderThread:2088494 [sender.py:send():379] send: summary 2024-06-15 14:39:42,519 INFO SenderThread:2088494 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end 2024-06-15 14:39:42,519 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,519 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 5 2024-06-15 14:39:42,519 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 6 2024-06-15 14:39:42,520 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,520 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 6 2024-06-15 14:39:42,520 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,520 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 6 2024-06-15 14:39:42,526 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: status_report 2024-06-15 14:39:42,696 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 7 2024-06-15 14:39:42,696 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:42,696 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 7 2024-06-15 14:39:42,697 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:42,697 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 7 2024-06-15 14:39:42,837 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml 2024-06-15 14:39:42,838 INFO Thread-12 :2088494 [dir_watcher.py:_on_file_modified():288] file/dir modified: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:39:43,298 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: poll_exit 2024-06-15 14:39:43,755 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 8 2024-06-15 14:39:43,755 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: poll_exit 2024-06-15 14:39:43,756 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:43,756 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 8 2024-06-15 14:39:43,756 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:43,757 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 8 2024-06-15 14:39:43,757 INFO SenderThread:2088494 [job_builder.py:build():440] Attempting to build job artifact 2024-06-15 14:39:43,789 INFO SenderThread:2088494 [job_builder.py:_get_source_type():580] no source found 2024-06-15 14:39:43,789 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 9 2024-06-15 14:39:43,789 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:43,789 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 9 2024-06-15 14:39:43,790 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:43,790 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 9 2024-06-15 14:39:43,790 INFO SenderThread:2088494 [dir_watcher.py:finish():358] shutting down directory watcher 2024-06-15 14:39:43,881 INFO SenderThread:2088494 [dir_watcher.py:finish():388] scan: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files 2024-06-15 14:39:43,893 INFO SenderThread:2088494 [dir_watcher.py:finish():402] scan save: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml config.yaml 2024-06-15 14:39:43,893 INFO SenderThread:2088494 [dir_watcher.py:finish():402] scan save: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/output.log output.log 2024-06-15 14:39:43,893 INFO SenderThread:2088494 [dir_watcher.py:finish():402] scan save: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/requirements.txt requirements.txt 2024-06-15 14:39:43,897 INFO SenderThread:2088494 [dir_watcher.py:finish():402] scan save: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-metadata.json wandb-metadata.json 2024-06-15 14:39:43,897 INFO SenderThread:2088494 [dir_watcher.py:finish():402] scan save: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json wandb-summary.json 2024-06-15 14:39:43,898 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 10 2024-06-15 14:39:43,898 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:43,898 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 10 2024-06-15 14:39:43,903 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:43,903 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 10 2024-06-15 14:39:43,903 INFO SenderThread:2088494 [file_pusher.py:finish():169] shutting down file pusher 2024-06-15 14:39:44,253 INFO wandb-upload_0:2088494 [upload_job.py:push():130] Uploaded file /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/config.yaml 2024-06-15 14:39:44,261 INFO wandb-upload_1:2088494 [upload_job.py:push():130] Uploaded file /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/output.log 2024-06-15 14:39:44,277 INFO wandb-upload_3:2088494 [upload_job.py:push():130] Uploaded file /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/wandb-summary.json 2024-06-15 14:39:44,299 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: poll_exit 2024-06-15 14:39:44,300 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: poll_exit 2024-06-15 14:39:44,315 INFO wandb-upload_2:2088494 [upload_job.py:push():130] Uploaded file /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/files/requirements.txt 2024-06-15 14:39:44,515 INFO Thread-11 :2088494 [sender.py:transition_state():614] send defer: 11 2024-06-15 14:39:44,516 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:44,516 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 11 2024-06-15 14:39:44,516 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:44,517 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 11 2024-06-15 14:39:44,517 INFO SenderThread:2088494 [file_pusher.py:join():175] waiting for file pusher 2024-06-15 14:39:44,517 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 12 2024-06-15 14:39:44,517 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:44,517 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 12 2024-06-15 14:39:44,517 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:44,518 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 12 2024-06-15 14:39:44,518 INFO SenderThread:2088494 [file_stream.py:finish():601] file stream finish called 2024-06-15 14:39:44,766 INFO SenderThread:2088494 [file_stream.py:finish():605] file stream finish is done 2024-06-15 14:39:44,766 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 13 2024-06-15 14:39:44,766 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:44,766 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 13 2024-06-15 14:39:44,766 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:44,766 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 13 2024-06-15 14:39:44,766 INFO SenderThread:2088494 [sender.py:transition_state():614] send defer: 14 2024-06-15 14:39:44,767 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: defer 2024-06-15 14:39:44,767 INFO HandlerThread:2088494 [handler.py:handle_request_defer():184] handle defer: 14 2024-06-15 14:39:44,767 DEBUG SenderThread:2088494 [sender.py:send():379] send: final 2024-06-15 14:39:44,767 DEBUG SenderThread:2088494 [sender.py:send():379] send: footer 2024-06-15 14:39:44,767 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: defer 2024-06-15 14:39:44,767 INFO SenderThread:2088494 [sender.py:send_request_defer():610] handle sender defer: 14 2024-06-15 14:39:44,768 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: poll_exit 2024-06-15 14:39:44,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: server_info 2024-06-15 14:39:44,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: poll_exit 2024-06-15 14:39:44,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: get_summary 2024-06-15 14:39:44,769 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: sampled_history 2024-06-15 14:39:44,770 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: internal_messages 2024-06-15 14:39:44,771 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: poll_exit 2024-06-15 14:39:44,771 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: server_info 2024-06-15 14:39:44,826 DEBUG SenderThread:2088494 [sender.py:send_request():406] send_request: poll_exit 2024-06-15 14:39:44,827 INFO MainThread:2088494 [wandb_run.py:_footer_history_summary_info():4008] rendering history 2024-06-15 14:39:44,828 INFO MainThread:2088494 [wandb_run.py:_footer_history_summary_info():4040] rendering summary 2024-06-15 14:39:44,828 INFO MainThread:2088494 [wandb_run.py:_footer_sync_info():3967] logging synced files 2024-06-15 14:39:44,829 DEBUG HandlerThread:2088494 [handler.py:handle_request():158] handle_request: shutdown 2024-06-15 14:39:44,829 INFO HandlerThread:2088494 [handler.py:finish():882] shutting down handler 2024-06-15 14:39:45,771 INFO WriterThread:2088494 [datastore.py:close():296] close: /jupyter_workspace/users/Darshan/prompting/wandb/run-20240615_114519-wfpe2teb/run-wfpe2teb.wandb 2024-06-15 14:39:45,827 INFO SenderThread:2088494 [sender.py:finish():1608] shutting down sender 2024-06-15 14:39:45,827 INFO SenderThread:2088494 [file_pusher.py:finish():169] shutting down file pusher 2024-06-15 14:39:45,827 INFO SenderThread:2088494 [file_pusher.py:join():175] waiting for file pusher