| [2024-11-19 05:53:03,496][__main__][INFO] - Using GPU for training. Main device : cuda:0 | |
| [2024-11-19 05:53:03,497][__main__][INFO] - Using multiple GPUs : [0, 1, 2, 3] | |
| [2024-11-19 05:53:09,128][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-11-19 05:53:09,147][__main__][INFO] - PSF min : 0.0 | |
| [2024-11-19 05:53:09,159][__main__][INFO] - PSF max : 0.12337537109851837 | |
| [2024-11-19 05:53:09,159][__main__][INFO] - PSF dtype : torch.float32 | |
| [2024-11-19 05:53:09,189][__main__][INFO] - PSF norm : 1.7320507764816284 | |
| [2024-11-19 05:53:09,190][__main__][INFO] - Reconstruction a few images with ADMM... | |
| [2024-11-19 05:53:09,811][__main__][INFO] - Cropped shape : (135, 240, 3) | |
| [2024-11-19 05:53:11,048][__main__][INFO] - Train test size : 24000 | |
| [2024-11-19 05:53:11,049][__main__][INFO] - Test test size : 999 | |
| [2024-11-19 05:53:11,171][__main__][INFO] - Training model with 8092627 parameters | |
| [2024-11-19 05:53:11,172][__main__][INFO] - -- Pre-process model with 3913696 parameters | |
| [2024-11-19 05:53:11,172][__main__][INFO] - -- Post-process model with 4051168 parameters | |
| [2024-11-19 05:53:11,173][__main__][INFO] - -- PSF network model with 127740 parameters | |
| [2024-11-19 05:53:11,173][__main__][INFO] - Setup time : 0.12404131889343262 s | |
| [2024-11-19 05:53:11,173][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-11-19 05:53:11,173][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-11-19/05-52-56 | |
| [2024-11-19 05:55:00,763][__main__][INFO] - Epoch 0 with learning rate [0.0001] | |
| [2024-11-19 07:04:18,522][__main__][INFO] - loss : 0.33474180833746975 | |
| [2024-11-19 07:06:01,767][__main__][INFO] - Epoch 1 with learning rate [0.0001] | |
| [2024-11-19 08:15:31,297][__main__][INFO] - loss : 0.23666251436620986 | |
| [2024-11-19 08:17:15,806][__main__][INFO] - Epoch 2 with learning rate [0.0001] | |
| [2024-11-19 09:26:38,305][__main__][INFO] - loss : 0.2112682097231352 | |
| [2024-11-19 09:28:21,576][__main__][INFO] - Epoch 3 with learning rate [0.0001] | |
| [2024-11-19 10:43:56,739][__main__][INFO] - loss : 0.19698103530332464 | |
| [2024-11-19 10:46:01,323][__main__][INFO] - Epoch 4 with learning rate [0.0001] | |
| [2024-11-19 11:57:00,324][__main__][INFO] - loss : 0.18757632012416933 | |
| [2024-11-19 11:58:45,678][__main__][INFO] - Epoch 5 with learning rate [0.0001] | |
| [2024-11-19 13:08:33,954][__main__][INFO] - loss : 0.18079082959393689 | |
| [2024-11-19 13:10:17,767][__main__][INFO] - Epoch 6 with learning rate [0.0001] | |
| [2024-11-19 14:19:48,976][__main__][INFO] - loss : 0.17538260021060675 | |
| [2024-11-19 14:21:33,278][__main__][INFO] - Epoch 7 with learning rate [0.0001] | |
| [2024-11-19 15:29:47,265][__main__][INFO] - loss : 0.17089155368631076 | |
| [2024-11-19 15:31:27,863][__main__][INFO] - Epoch 8 with learning rate [0.0001] | |
| [2024-11-19 16:38:29,247][__main__][INFO] - loss : 0.16691201605523673 | |
| [2024-11-19 16:40:10,736][__main__][INFO] - Epoch 9 with learning rate [0.0001] | |
| [2024-11-19 17:47:51,362][__main__][INFO] - loss : 0.16360624329994153 | |
| [2024-11-19 17:49:35,495][__main__][INFO] - Epoch 10 with learning rate [0.0001] | |
| [2024-11-19 19:03:22,565][__main__][INFO] - loss : 0.16039565959448618 | |
| [2024-11-19 19:05:09,373][__main__][INFO] - Epoch 11 with learning rate [0.0001] | |
| [2024-11-19 20:19:29,793][__main__][INFO] - loss : 0.1572699058751265 | |
| [2024-11-19 20:21:17,224][__main__][INFO] - Epoch 12 with learning rate [0.0001] | |
| [2024-11-19 21:35:33,193][__main__][INFO] - loss : 0.15467030574629742 | |
| [2024-11-19 21:37:19,221][__main__][INFO] - Epoch 13 with learning rate [0.0001] | |
| [2024-11-19 22:49:34,670][__main__][INFO] - loss : 0.15243539773176157 | |
| [2024-11-19 22:51:18,745][__main__][INFO] - Epoch 14 with learning rate [0.0001] | |
| [2024-11-20 00:02:13,879][__main__][INFO] - loss : 0.15018465863044034 | |
| [2024-11-20 00:04:00,205][__main__][INFO] - Epoch 15 with learning rate [0.0001] | |
| [2024-11-20 01:14:58,868][__main__][INFO] - loss : 0.14805763907358127 | |
| [2024-11-20 01:16:42,628][__main__][INFO] - Epoch 16 with learning rate [0.0001] | |
| [2024-11-20 02:27:40,064][__main__][INFO] - loss : 0.14620344266047056 | |
| [2024-11-20 02:29:23,832][__main__][INFO] - Epoch 17 with learning rate [0.0001] | |
| [2024-11-20 03:40:01,774][__main__][INFO] - loss : 0.1442781962888937 | |
| [2024-11-20 03:41:45,988][__main__][INFO] - Epoch 18 with learning rate [0.0001] | |
| [2024-11-20 04:52:43,165][__main__][INFO] - loss : 0.14252281477178155 | |
| [2024-11-20 04:54:28,779][__main__][INFO] - Epoch 19 with learning rate [0.0001] | |
| [2024-11-20 06:05:18,487][__main__][INFO] - loss : 0.14099546737596433 | |
| [2024-11-20 06:07:01,795][__main__][INFO] - Epoch 20 with learning rate [0.0001] | |
| [2024-11-20 07:17:58,309][__main__][INFO] - loss : 0.13948831555992322 | |
| [2024-11-20 07:19:42,369][__main__][INFO] - Epoch 21 with learning rate [0.0001] | |
| [2024-11-20 08:30:23,133][__main__][INFO] - loss : 0.13791773682087663 | |
| [2024-11-20 08:32:07,598][__main__][INFO] - Epoch 22 with learning rate [0.0001] | |
| [2024-11-20 09:46:13,119][__main__][INFO] - loss : 0.13678626186152315 | |
| [2024-11-20 09:47:56,896][__main__][INFO] - Epoch 23 with learning rate [0.0001] | |
| [2024-11-20 10:58:40,868][__main__][INFO] - loss : 0.13553074314072708 | |
| [2024-11-20 11:00:23,988][__main__][INFO] - Epoch 24 with learning rate [0.0001] | |
| [2024-11-20 12:09:37,427][__main__][INFO] - loss : 0.13425350208704662 | |
| [2024-11-20 12:11:30,703][__main__][INFO] - Train time [hour] : 30.30495284418265 h | |
| [2024-11-20 12:11:30,703][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-11-19/05-52-56 | |