| [2024-09-06 06:27:08,116][__main__][INFO] - Using GPU for training. Main device : cuda:0 | |
| [2024-09-06 06:27:08,117][__main__][INFO] - Using multiple GPUs : [0, 1, 2, 3] | |
| [2024-09-06 06:27:15,341][__main__][INFO] - PSF shape : torch.Size([1, 380, 507, 3]) | |
| [2024-09-06 06:27:15,369][__main__][INFO] - PSF min : 0.0 | |
| [2024-09-06 06:27:15,378][__main__][INFO] - PSF max : 0.04469018802046776 | |
| [2024-09-06 06:27:15,378][__main__][INFO] - PSF dtype : torch.float32 | |
| [2024-09-06 06:27:15,403][__main__][INFO] - PSF norm : 1.000011682510376 | |
| [2024-09-06 06:27:15,404][__main__][INFO] - Reconstruction a few images with ADMM... | |
| [2024-09-06 06:27:16,006][__main__][INFO] - Cropped shape : (123, 123, 3) | |
| [2024-09-06 06:27:16,238][__main__][INFO] - Cropped shape : (123, 123, 3) | |
| [2024-09-06 06:27:18,473][__main__][INFO] - Train test size : 21250 | |
| [2024-09-06 06:27:18,473][__main__][INFO] - Test test size : 3750 | |
| [2024-09-06 06:27:18,591][__main__][INFO] - Training model with 8680894 parameters | |
| [2024-09-06 06:27:18,591][__main__][INFO] - -- Pre-process model with 4051744 parameters | |
| [2024-09-06 06:27:18,592][__main__][INFO] - -- Post-process model with 4051168 parameters | |
| [2024-09-06 06:27:18,592][__main__][INFO] - Setup time : 0.11874675750732422 s | |
| [2024-09-06 06:27:18,592][__main__][INFO] - PSF shape : torch.Size([1, 380, 507, 3]) | |
| [2024-09-06 06:27:18,592][__main__][INFO] - Results saved in /root/FORKS/LenslessPiCamStefan/outputs/2024-09-06/06-26-59 | |
| [2024-09-06 06:34:24,368][__main__][INFO] - Epoch 0 with learning rate [0.0, 0.0] | |
| [2024-09-06 08:03:11,393][__main__][INFO] - loss : 0.8538881604132518 | |
| [2024-09-06 08:10:16,993][__main__][INFO] - Epoch 1 with learning rate [0.0001, 0.0001] | |
| [2024-09-06 09:39:36,955][__main__][INFO] - loss : 0.6313050793946284 | |
| [2024-09-06 09:46:44,360][__main__][INFO] - Epoch 2 with learning rate [9.957224306869053e-05, 9.957224306869053e-05] | |
| [2024-09-06 11:12:44,584][__main__][INFO] - loss : 0.5196849361115358 | |
| [2024-09-06 11:19:48,452][__main__][INFO] - Epoch 3 with learning rate [9.829629131445342e-05, 9.829629131445342e-05] | |
| [2024-09-06 12:45:43,030][__main__][INFO] - loss : 0.481338901465253 | |
| [2024-09-06 12:52:50,609][__main__][INFO] - Epoch 4 with learning rate [9.619397662556435e-05, 9.619397662556435e-05] | |
| [2024-09-06 14:18:46,898][__main__][INFO] - loss : 0.45601863606308657 | |
| [2024-09-06 14:25:54,680][__main__][INFO] - Epoch 5 with learning rate [9.330127018922194e-05, 9.330127018922194e-05] | |
| [2024-09-06 15:51:48,447][__main__][INFO] - loss : 0.4381963453924688 | |
| [2024-09-06 15:58:58,029][__main__][INFO] - Epoch 6 with learning rate [8.966766701456177e-05, 8.966766701456177e-05] | |
| [2024-09-06 17:24:55,524][__main__][INFO] - loss : 0.42479857364864054 | |
| [2024-09-06 17:32:02,197][__main__][INFO] - Epoch 7 with learning rate [8.535533905932738e-05, 8.535533905932738e-05] | |
| [2024-09-06 18:57:50,892][__main__][INFO] - loss : 0.4138986376995383 | |
| [2024-09-06 19:04:55,659][__main__][INFO] - Epoch 8 with learning rate [8.043807145043604e-05, 8.043807145043604e-05] | |
| [2024-09-06 20:30:45,182][__main__][INFO] - loss : 0.403856563361693 | |
| [2024-09-06 20:37:53,319][__main__][INFO] - Epoch 9 with learning rate [7.500000000000001e-05, 7.500000000000001e-05] | |
| [2024-09-06 22:03:38,764][__main__][INFO] - loss : 0.39436730755916877 | |
| [2024-09-06 22:10:44,605][__main__][INFO] - Epoch 10 with learning rate [6.91341716182545e-05, 6.91341716182545e-05] | |
| [2024-09-06 23:36:30,984][__main__][INFO] - loss : 0.3847278827342434 | |
| [2024-09-06 23:43:34,672][__main__][INFO] - Epoch 11 with learning rate [6.294095225512603e-05, 6.294095225512603e-05] | |
| [2024-09-07 01:09:22,871][__main__][INFO] - loss : 0.37583704075413044 | |
| [2024-09-07 01:16:31,948][__main__][INFO] - Epoch 12 with learning rate [5.6526309611002594e-05, 5.6526309611002594e-05] | |
| [2024-09-07 02:42:24,521][__main__][INFO] - loss : 0.367830813090926 | |
| [2024-09-07 02:49:32,941][__main__][INFO] - Epoch 13 with learning rate [5e-05, 5e-05] | |
| [2024-09-07 04:15:18,815][__main__][INFO] - loss : 0.3602828741993544 | |
| [2024-09-07 04:22:23,879][__main__][INFO] - Epoch 14 with learning rate [4.347369038899744e-05, 4.347369038899744e-05] | |
| [2024-09-07 05:48:13,628][__main__][INFO] - loss : 0.35356986953189934 | |
| [2024-09-07 05:55:19,366][__main__][INFO] - Epoch 15 with learning rate [3.705904774487396e-05, 3.705904774487396e-05] | |
| [2024-09-07 07:21:10,928][__main__][INFO] - loss : 0.3470845077079536 | |
| [2024-09-07 07:28:13,608][__main__][INFO] - Epoch 16 with learning rate [3.086582838174551e-05, 3.086582838174551e-05] | |
| [2024-09-07 08:58:17,370][__main__][INFO] - loss : 0.34131409294879433 | |
| [2024-09-07 09:05:27,292][__main__][INFO] - Epoch 17 with learning rate [2.500000000000001e-05, 2.500000000000001e-05] | |
| [2024-09-07 10:32:21,302][__main__][INFO] - loss : 0.33584241915978763 | |
| [2024-09-07 10:39:31,784][__main__][INFO] - Epoch 18 with learning rate [1.9561928549563968e-05, 1.9561928549563968e-05] | |
| [2024-09-07 12:06:31,757][__main__][INFO] - loss : 0.33108553609257113 | |
| [2024-09-07 12:13:42,901][__main__][INFO] - Epoch 19 with learning rate [1.4644660940672627e-05, 1.4644660940672627e-05] | |
| [2024-09-07 13:40:43,686][__main__][INFO] - loss : 0.3267359206445601 | |
| [2024-09-07 13:47:53,746][__main__][INFO] - Epoch 20 with learning rate [1.0332332985438248e-05, 1.0332332985438248e-05] | |
| [2024-09-07 15:14:54,737][__main__][INFO] - loss : 0.32305995752004474 | |
| [2024-09-07 15:22:06,291][__main__][INFO] - Epoch 21 with learning rate [6.698729810778065e-06, 6.698729810778065e-06] | |
| [2024-09-07 16:49:07,663][__main__][INFO] - loss : 0.3201389898104832 | |
| [2024-09-07 16:56:18,887][__main__][INFO] - Epoch 22 with learning rate [3.8060233744356633e-06, 3.8060233744356633e-06] | |
| [2024-09-07 18:23:17,436][__main__][INFO] - loss : 0.3179086854026829 | |
| [2024-09-07 18:30:27,294][__main__][INFO] - Epoch 23 with learning rate [1.70370868554659e-06, 1.70370868554659e-06] | |
| [2024-09-07 19:57:23,021][__main__][INFO] - loss : 0.3163560382305237 | |
| [2024-09-07 20:04:30,854][__main__][INFO] - Epoch 24 with learning rate [4.277569313094809e-07, 4.277569313094809e-07] | |
| [2024-09-07 21:31:32,655][__main__][INFO] - loss : 0.3154664968150763 | |
| [2024-09-07 21:38:43,270][__main__][INFO] - Train time [hour] : 39.18965485354265 h | |
| [2024-09-07 21:38:43,270][__main__][INFO] - Results saved in /root/FORKS/LenslessPiCamStefan/outputs/2024-09-06/06-26-59 | |