Use bfloat16 for core module.
Use parallel attention and MLP in ViViT.

Epoch 001/400
Train		loss: 112704208.00	correlation: 0.0126
Validation	loss: 199545376.00	correlation: 0.0293
Elapse: 540.35s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 002/400
Train		loss: 97414480.00	correlation: 0.0393
Validation	loss: 198820640.00	correlation: 0.0410
Elapse: 549.83s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 003/400
Train		loss: 95851936.00	correlation: 0.0545
Validation	loss: 197542912.00	correlation: 0.0493
Elapse: 552.73s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 004/400
Train		loss: 94762680.00	correlation: 0.0658
Validation	loss: 195978896.00	correlation: 0.0592
Elapse: 553.22s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 005/400
Train		loss: 93366904.00	correlation: 0.0807
Validation	loss: 193138784.00	correlation: 0.0786
Elapse: 551.37s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 006/400
Train		loss: 91530000.00	correlation: 0.0996
Validation	loss: 190414640.00	correlation: 0.0957
Elapse: 548.87s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 007/400
Train		loss: 90052112.00	correlation: 0.1151
Validation	loss: 187958800.00	correlation: 0.1117
Elapse: 545.45s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 008/400
Train		loss: 88550296.00	correlation: 0.1303
Validation	loss: 185819104.00	correlation: 0.1231
Elapse: 542.13s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 009/400
Train		loss: 87211088.00	correlation: 0.1444
Validation	loss: 183781008.00	correlation: 0.1379
Elapse: 540.39s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 010/400
Train		loss: 85912744.00	correlation: 0.1575
Validation	loss: 182160864.00	correlation: 0.1483
Elapse: 539.93s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 011/400
Train		loss: 84825776.00	correlation: 0.1681
Validation	loss: 180796960.00	correlation: 0.1574
Elapse: 539.05s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 012/400
Train		loss: 83932096.00	correlation: 0.1768
Validation	loss: 179665872.00	correlation: 0.1651
Elapse: 539.83s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 013/400
Train		loss: 83185960.00	correlation: 0.1841
Validation	loss: 178867920.00	correlation: 0.1706
Elapse: 540.49s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 014/400
Train		loss: 82619600.00	correlation: 0.1896
Validation	loss: 178183616.00	correlation: 0.1749
Elapse: 540.25s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 015/400
Train		loss: 82049104.00	correlation: 0.1953
Validation	loss: 177195872.00	correlation: 0.1811
Elapse: 539.98s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 016/400
Train		loss: 81438744.00	correlation: 0.2013
Validation	loss: 176732480.00	correlation: 0.1848
Elapse: 539.92s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 017/400
Train		loss: 80981184.00	correlation: 0.2058
Validation	loss: 175869328.00	correlation: 0.1895
Elapse: 540.34s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 018/400
Train		loss: 80463984.00	correlation: 0.2108
Validation	loss: 175137504.00	correlation: 0.1941
Elapse: 540.52s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 019/400
Train		loss: 80076456.00	correlation: 0.2145
Validation	loss: 174743216.00	correlation: 0.1976
Elapse: 540.79s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 020/400
Train		loss: 79770240.00	correlation: 0.2180
Validation	loss: 174354656.00	correlation: 0.1999
Elapse: 541.02s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 021/400
Train		loss: 79389680.00	correlation: 0.2210
Validation	loss: 173737072.00	correlation: 0.2049
Elapse: 540.85s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 022/400
Train		loss: 79099264.00	correlation: 0.2238
Validation	loss: 173426080.00	correlation: 0.2057
Elapse: 542.08s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 023/400
Train		loss: 78893584.00	correlation: 0.2259
Validation	loss: 172965088.00	correlation: 0.2094
Elapse: 542.73s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 024/400
Train		loss: 78610448.00	correlation: 0.2286
Validation	loss: 172757408.00	correlation: 0.2102
Elapse: 543.17s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 025/400
Train		loss: 78350984.00	correlation: 0.2311
Validation	loss: 172301040.00	correlation: 0.2136
Elapse: 543.01s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 026/400
Train		loss: 78082256.00	correlation: 0.2338
Validation	loss: 172086432.00	correlation: 0.2145
Elapse: 543.35s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 027/400
Train		loss: 77827456.00	correlation: 0.2363
Validation	loss: 171786464.00	correlation: 0.2169
Elapse: 543.66s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 028/400
Train		loss: 77638136.00	correlation: 0.2379
Validation	loss: 171793264.00	correlation: 0.2171
Elapse: 543.62s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 029/400
Train		loss: 77553520.00	correlation: 0.2390
Validation	loss: 171183824.00	correlation: 0.2206
Elapse: 543.14s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 030/400
Train		loss: 77293184.00	correlation: 0.2414
Validation	loss: 171063472.00	correlation: 0.2218
Elapse: 542.93s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 031/400
Train		loss: 77137136.00	correlation: 0.2425
Validation	loss: 170927232.00	correlation: 0.2215
Elapse: 542.90s

Epoch 032/400
Train		loss: 77036008.00	correlation: 0.2439
Validation	loss: 170678112.00	correlation: 0.2241
Elapse: 544.22s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 033/400
Train		loss: 76850512.00	correlation: 0.2458
Validation	loss: 170585168.00	correlation: 0.2249
Elapse: 543.38s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 034/400
Train		loss: 76745528.00	correlation: 0.2467
Validation	loss: 170361008.00	correlation: 0.2261
Elapse: 543.46s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 035/400
Train		loss: 76631640.00	correlation: 0.2479
Validation	loss: 170159952.00	correlation: 0.2272
Elapse: 544.31s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 036/400
Train		loss: 76572216.00	correlation: 0.2483
Validation	loss: 170068624.00	correlation: 0.2280
Elapse: 544.03s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 037/400
Train		loss: 76306000.00	correlation: 0.2511
Validation	loss: 170078272.00	correlation: 0.2281
Elapse: 543.66s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 038/400
Train		loss: 76521968.00	correlation: 0.2488
Validation	loss: 170034304.00	correlation: 0.2284
Elapse: 543.78s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 039/400
Train		loss: 76277552.00	correlation: 0.2512
Validation	loss: 169955232.00	correlation: 0.2283
Elapse: 544.11s

Epoch 040/400
Train		loss: 76083856.00	correlation: 0.2532
Validation	loss: 169547568.00	correlation: 0.2316
Elapse: 544.27s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 041/400
Train		loss: 76034800.00	correlation: 0.2536
Validation	loss: 169778400.00	correlation: 0.2301
Elapse: 544.31s

Epoch 042/400
Train		loss: 75948104.00	correlation: 0.2542
Validation	loss: 169703472.00	correlation: 0.2304
Elapse: 543.89s

Epoch 043/400
Train		loss: 75900336.00	correlation: 0.2549
Validation	loss: 169460816.00	correlation: 0.2314
Elapse: 543.95s

Epoch 044/400
Train		loss: 75856872.00	correlation: 0.2554
Validation	loss: 169446544.00	correlation: 0.2314
Elapse: 543.85s

Epoch 045/400
Train		loss: 75771024.00	correlation: 0.2563
Validation	loss: 169373568.00	correlation: 0.2320
Elapse: 544.58s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 046/400
Train		loss: 75747888.00	correlation: 0.2564
Validation	loss: 169484960.00	correlation: 0.2316
Elapse: 544.29s

Epoch 047/400
Train		loss: 75614488.00	correlation: 0.2578
Validation	loss: 169374048.00	correlation: 0.2332
Elapse: 544.59s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 048/400
Train		loss: 75621768.00	correlation: 0.2577
Validation	loss: 169829152.00	correlation: 0.2292
Elapse: 544.60s

Epoch 049/400
Train		loss: 75540576.00	correlation: 0.2584
Validation	loss: 169151584.00	correlation: 0.2322
Elapse: 545.07s

Epoch 050/400
Train		loss: 75552112.00	correlation: 0.2587
Validation	loss: 169218528.00	correlation: 0.2327
Elapse: 544.47s

Epoch 051/400
Train		loss: 75440728.00	correlation: 0.2597
Validation	loss: 169177248.00	correlation: 0.2329
Elapse: 544.75s

Epoch 052/400
Train		loss: 75499728.00	correlation: 0.2591
Validation	loss: 169380720.00	correlation: 0.2327
Elapse: 544.77s

Loaded checkpoint from epoch 47 (correlation: 0.2332).

Reduce learning rate of core to 1.4400e-03 (num. reduce: 1).
Reduce learning rate of readouts to 1.0800e-03 (num. reduce: 1).
Reduce learning rate of shifters to 1.0800e-03 (num. reduce: 1).

Epoch 053/400
Train		loss: 73633064.00	correlation: 0.2750
Validation	loss: 167526240.00	correlation: 0.2446
Elapse: 545.49s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 054/400
Train		loss: 72992880.00	correlation: 0.2809
Validation	loss: 167505792.00	correlation: 0.2447
Elapse: 545.66s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 055/400
Train		loss: 72791024.00	correlation: 0.2827
Validation	loss: 167337248.00	correlation: 0.2451
Elapse: 545.82s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 056/400
Train		loss: 72699672.00	correlation: 0.2837
Validation	loss: 167396864.00	correlation: 0.2453
Elapse: 545.65s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 057/400
Train		loss: 72666128.00	correlation: 0.2841
Validation	loss: 167320224.00	correlation: 0.2457
Elapse: 546.33s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 058/400
Train		loss: 72662680.00	correlation: 0.2840
Validation	loss: 167358624.00	correlation: 0.2457
Elapse: 545.38s

Epoch 059/400
Train		loss: 72528456.00	correlation: 0.2854
Validation	loss: 167347344.00	correlation: 0.2456
Elapse: 546.44s

Epoch 060/400
Train		loss: 72553424.00	correlation: 0.2854
Validation	loss: 167294624.00	correlation: 0.2462
Elapse: 546.17s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 061/400
Train		loss: 72496144.00	correlation: 0.2860
Validation	loss: 167428896.00	correlation: 0.2444
Elapse: 545.96s

Epoch 062/400
Train		loss: 72479344.00	correlation: 0.2859
Validation	loss: 167235104.00	correlation: 0.2454
Elapse: 546.11s

Epoch 063/400
Train		loss: 72437912.00	correlation: 0.2863
Validation	loss: 167384528.00	correlation: 0.2447
Elapse: 546.05s

Epoch 064/400
Train		loss: 72443952.00	correlation: 0.2864
Validation	loss: 167276464.00	correlation: 0.2452
Elapse: 546.23s

Epoch 065/400
Train		loss: 72421648.00	correlation: 0.2869
Validation	loss: 167359664.00	correlation: 0.2448
Elapse: 546.55s

Loaded checkpoint from epoch 60 (correlation: 0.2462).

Reduce learning rate of core to 4.3200e-04 (num. reduce: 1).
Reduce learning rate of readouts to 3.2400e-04 (num. reduce: 1).
Reduce learning rate of shifters to 3.2400e-04 (num. reduce: 1).

Epoch 066/400
Train		loss: 71631360.00	correlation: 0.2929
Validation	loss: 166762592.00	correlation: 0.2488
Elapse: 546.04s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 067/400
Train		loss: 71301752.00	correlation: 0.2963
Validation	loss: 166766816.00	correlation: 0.2491
Elapse: 546.30s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 068/400
Train		loss: 71239384.00	correlation: 0.2970
Validation	loss: 166698608.00	correlation: 0.2493
Elapse: 546.54s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 069/400
Train		loss: 71140904.00	correlation: 0.2977
Validation	loss: 166688480.00	correlation: 0.2493
Elapse: 546.57s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 070/400
Train		loss: 71157128.00	correlation: 0.2979
Validation	loss: 166701680.00	correlation: 0.2493
Elapse: 546.93s

Epoch 071/400
Train		loss: 71109936.00	correlation: 0.2983
Validation	loss: 166666112.00	correlation: 0.2493
Elapse: 546.33s

Epoch 072/400
Train		loss: 71014384.00	correlation: 0.2990
Validation	loss: 166637680.00	correlation: 0.2493
Elapse: 546.25s

Epoch 073/400
Train		loss: 71012144.00	correlation: 0.2989
Validation	loss: 166633760.00	correlation: 0.2495
Elapse: 546.14s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 074/400
Train		loss: 70962312.00	correlation: 0.2996
Validation	loss: 166724848.00	correlation: 0.2491
Elapse: 546.66s

Epoch 075/400
Train		loss: 70909096.00	correlation: 0.3002
Validation	loss: 166680192.00	correlation: 0.2492
Elapse: 546.39s

Epoch 076/400
Train		loss: 70859696.00	correlation: 0.3007
Validation	loss: 166666160.00	correlation: 0.2493
Elapse: 546.76s

Epoch 077/400
Train		loss: 70862616.00	correlation: 0.3006
Validation	loss: 166644512.00	correlation: 0.2493
Elapse: 546.35s

Epoch 078/400
Train		loss: 70866920.00	correlation: 0.3008
Validation	loss: 166689088.00	correlation: 0.2489
Elapse: 546.43s

Loaded checkpoint from epoch 73 (correlation: 0.2495).

Reduce learning rate of core to 1.2960e-04 (num. reduce: 1).
Reduce learning rate of readouts to 9.7200e-05 (num. reduce: 1).
Reduce learning rate of shifters to 9.7200e-05 (num. reduce: 1).

Epoch 079/400
Train		loss: 70659088.00	correlation: 0.3023
Validation	loss: 166495968.00	correlation: 0.2504
Elapse: 546.32s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 080/400
Train		loss: 70583640.00	correlation: 0.3029
Validation	loss: 166499952.00	correlation: 0.2503
Elapse: 546.55s

Epoch 081/400
Train		loss: 70541232.00	correlation: 0.3031
Validation	loss: 166486608.00	correlation: 0.2504
Elapse: 546.44s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 082/400
Train		loss: 70561208.00	correlation: 0.3030
Validation	loss: 166498080.00	correlation: 0.2505
Elapse: 546.48s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 083/400
Train		loss: 70504848.00	correlation: 0.3037
Validation	loss: 166479744.00	correlation: 0.2504
Elapse: 545.91s

Epoch 084/400
Train		loss: 70483280.00	correlation: 0.3037
Validation	loss: 166527136.00	correlation: 0.2504
Elapse: 546.39s

Epoch 085/400
Train		loss: 70486104.00	correlation: 0.3039
Validation	loss: 166507024.00	correlation: 0.2504
Elapse: 546.66s

Epoch 086/400
Train		loss: 70448464.00	correlation: 0.3042
Validation	loss: 166480160.00	correlation: 0.2505
Elapse: 546.13s

Epoch 087/400
Train		loss: 70433528.00	correlation: 0.3043
Validation	loss: 166521664.00	correlation: 0.2504
Elapse: 546.51s

Loaded checkpoint from epoch 82 (correlation: 0.2505).

Reduce learning rate of core to 3.8880e-05 (num. reduce: 1).
Reduce learning rate of readouts to 2.9160e-05 (num. reduce: 1).
Reduce learning rate of shifters to 2.9160e-05 (num. reduce: 1).

Epoch 088/400
Train		loss: 70419248.00	correlation: 0.3041
Validation	loss: 166470848.00	correlation: 0.2507
Elapse: 546.72s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 089/400
Train		loss: 70456936.00	correlation: 0.3039
Validation	loss: 166478544.00	correlation: 0.2507
Elapse: 546.31s

Epoch 090/400
Train		loss: 70377392.00	correlation: 0.3047
Validation	loss: 166470880.00	correlation: 0.2508
Elapse: 546.64s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 091/400
Train		loss: 70370720.00	correlation: 0.3048
Validation	loss: 166471712.00	correlation: 0.2507
Elapse: 546.55s

Epoch 092/400
Train		loss: 70332624.00	correlation: 0.3052
Validation	loss: 166468176.00	correlation: 0.2506
Elapse: 546.51s

Epoch 093/400
Train		loss: 70375248.00	correlation: 0.3046
Validation	loss: 166466304.00	correlation: 0.2507
Elapse: 547.09s

Epoch 094/400
Train		loss: 70312208.00	correlation: 0.3053
Validation	loss: 166426080.00	correlation: 0.2509
Elapse: 546.36s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 095/400
Train		loss: 70306024.00	correlation: 0.3054
Validation	loss: 166448992.00	correlation: 0.2509
Elapse: 546.42s

Epoch 096/400
Train		loss: 70301760.00	correlation: 0.3053
Validation	loss: 166460400.00	correlation: 0.2508
Elapse: 545.99s

Epoch 097/400
Train		loss: 70339392.00	correlation: 0.3050
Validation	loss: 166448912.00	correlation: 0.2507
Elapse: 546.74s

Epoch 098/400
Train		loss: 70365064.00	correlation: 0.3048
Validation	loss: 166476400.00	correlation: 0.2506
Elapse: 546.17s

Epoch 099/400
Train		loss: 70304792.00	correlation: 0.3053
Validation	loss: 166451168.00	correlation: 0.2507
Elapse: 545.82s

Loaded checkpoint from epoch 94 (correlation: 0.2509).

Reduce learning rate of core to 1.1664e-05 (num. reduce: 1).
Reduce learning rate of readouts to 8.7480e-06 (num. reduce: 1).
Reduce learning rate of shifters to 8.7480e-06 (num. reduce: 1).

Epoch 100/400
Train		loss: 70282520.00	correlation: 0.3055
Validation	loss: 166444240.00	correlation: 0.2509
Elapse: 546.60s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 101/400
Train		loss: 70321056.00	correlation: 0.3050
Validation	loss: 166451424.00	correlation: 0.2509
Elapse: 546.61s

Epoch 102/400
Train		loss: 70312536.00	correlation: 0.3052
Validation	loss: 166450992.00	correlation: 0.2509
Elapse: 546.64s

Epoch 103/400
Train		loss: 70294928.00	correlation: 0.3057
Validation	loss: 166437664.00	correlation: 0.2509
Elapse: 546.47s

Epoch 104/400
Train		loss: 70265648.00	correlation: 0.3058
Validation	loss: 166443488.00	correlation: 0.2509
Elapse: 546.86s

Epoch 105/400
Train		loss: 70228080.00	correlation: 0.3058
Validation	loss: 166447312.00	correlation: 0.2508
Elapse: 546.77s

Loaded checkpoint from epoch 100 (correlation: 0.2509).

Reduce learning rate of core to 3.4992e-06 (num. reduce: 1).
Reduce learning rate of readouts to 2.6244e-06 (num. reduce: 1).
Reduce learning rate of shifters to 2.6244e-06 (num. reduce: 1).

Epoch 106/400
Train		loss: 70303288.00	correlation: 0.3053
Validation	loss: 166441600.00	correlation: 0.2509
Elapse: 546.61s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 107/400
Train		loss: 70329360.00	correlation: 0.3052
Validation	loss: 166438976.00	correlation: 0.2509
Elapse: 546.25s

Checkpoint saved to /home/storage/runs/vivit_ensemble/012/ckpt/model_state.pt.

Epoch 108/400
Train		loss: 70249752.00	correlation: 0.3063
Validation	loss: 166440032.00	correlation: 0.2509
Elapse: 546.40s

Epoch 109/400
Train		loss: 70245592.00	correlation: 0.3059
Validation	loss: 166436832.00	correlation: 0.2509
Elapse: 546.34s

Epoch 110/400
Train		loss: 70323520.00	correlation: 0.3050
Validation	loss: 166439552.00	correlation: 0.2509
Elapse: 546.33s

Epoch 111/400
Train		loss: 70291648.00	correlation: 0.3053
Validation	loss: 166438448.00	correlation: 0.2509
Elapse: 546.45s

Epoch 112/400
Train		loss: 70337264.00	correlation: 0.3050
Validation	loss: 166435040.00	correlation: 0.2509
Elapse: 546.37s

Loaded checkpoint from epoch 107 (correlation: 0.2509).

Reduce learning rate of core to 1.0498e-06 (num. reduce: 1).
Reduce learning rate of readouts to 7.8732e-07 (num. reduce: 1).
Reduce learning rate of shifters to 7.8732e-07 (num. reduce: 1).

Epoch 113/400
Train		loss: 70326192.00	correlation: 0.3050
Validation	loss: 166438976.00	correlation: 0.2509
Elapse: 546.86s

Epoch 114/400
Train		loss: 70297808.00	correlation: 0.3056
Validation	loss: 166439680.00	correlation: 0.2509
Elapse: 546.99s

Epoch 115/400
Train		loss: 70375312.00	correlation: 0.3045
Validation	loss: 166439312.00	correlation: 0.2509
Elapse: 547.26s

Epoch 116/400
Train		loss: 70331832.00	correlation: 0.3050
Validation	loss: 166439392.00	correlation: 0.2509
Elapse: 546.75s

Epoch 117/400
Train		loss: 70241608.00	correlation: 0.3060
Validation	loss: 166441104.00	correlation: 0.2509
Elapse: 546.43s

Loaded checkpoint from epoch 107 (correlation: 0.2509).

Reduce learning rate of core to 3.1493e-07 (num. reduce: 2).
Reduce learning rate of readouts to 2.3620e-07 (num. reduce: 2).
Reduce learning rate of shifters to 2.3620e-07 (num. reduce: 2).

Epoch 118/400
Train		loss: 70344976.00	correlation: 0.3049
Validation	loss: 166439680.00	correlation: 0.2509
Elapse: 546.75s

Epoch 119/400
Train		loss: 70278184.00	correlation: 0.3054
Validation	loss: 166439840.00	correlation: 0.2509
Elapse: 547.33s

Epoch 120/400
Train		loss: 70224856.00	correlation: 0.3062
Validation	loss: 166439440.00	correlation: 0.2509
Elapse: 546.94s

Epoch 121/400
Train		loss: 70317744.00	correlation: 0.3049
Validation	loss: 166439280.00	correlation: 0.2509
Elapse: 547.22s

Epoch 122/400
Train		loss: 70322624.00	correlation: 0.3052
Validation	loss: 166438784.00	correlation: 0.2509
Elapse: 546.83s

Model has not improved after 2 LR reductions.

Loaded checkpoint from epoch 107 (correlation: 0.2509).


ValidationA: 0.2475	B: 0.2751	C: 0.2730	D: 0.2364	E: 0.2355	F: 0.2343	G: 0.2543	H: 0.2344	I: 0.2602	J: 0.2588	average: 0.2509

Results saved to /home/storage/runs/vivit_ensemble/012.