| Model pushed to 1 GPU(s), type NVIDIA GeForce RTX 3090. | |
| Loaded pretrained model from /data/shared/luojun/runs/rain1/weights/checkpoint.pth.tar | |
| --- Training --- | |
| Epoch 0 train loss: 0.4547, acc: 0.9213 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.850 | |
| mIoU improved from 0.0000 to 0.4301. | |
| mIoU improved from 0.0000 to 0.6558. | |
| --- Training --- | |
| Epoch 1 train loss: 0.4522, acc: 0.9217 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.862 | |
| mIoU improved from 0.4301 to 0.4614. | |
| --- Training --- | |
| Epoch 2 train loss: 0.4485, acc: 0.9223 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.867 | |
| --- Training --- | |
| Epoch 3 train loss: 0.4430, acc: 0.9229 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.866 | |
| --- Training --- | |
| Epoch 4 train loss: 0.4388, acc: 0.9242 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| mIoU improved from 0.4614 to 0.4618. | |
| mIoU improved from 0.6558 to 0.6604. | |
| --- Training --- | |
| Epoch 5 train loss: 0.4378, acc: 0.9246 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.871 | |
| --- Training --- | |
| Epoch 6 train loss: 0.4361, acc: 0.9243 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.871 | |
| --- Training --- | |
| Epoch 7 train loss: 0.4331, acc: 0.9251 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.854 | |
| --- Training --- | |
| Epoch 8 train loss: 0.4325, acc: 0.9253 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| --- Training --- | |
| Epoch 9 train loss: 0.4313, acc: 0.9258 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.859 | |
| --- Training --- | |
| Epoch 10 train loss: 0.4257, acc: 0.9260 | |
| --- Validation - Source --- | |
| * Acc 0.936 | |
| --- Validation - Target --- | |
| * Acc 0.879 | |
| mIoU improved from 0.4618 to 0.4678. | |
| mIoU improved from 0.6604 to 0.6637. | |
| --- Training --- | |
| Epoch 11 train loss: 0.4268, acc: 0.9261 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.866 | |
| --- Training --- | |
| Epoch 12 train loss: 0.4234, acc: 0.9269 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.859 | |
| --- Training --- | |
| Epoch 13 train loss: 0.4219, acc: 0.9270 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.869 | |
| --- Training --- | |
| Epoch 14 train loss: 0.4185, acc: 0.9279 | |
| --- Validation - Source --- | |
| * Acc 0.937 | |
| --- Validation - Target --- | |
| * Acc 0.867 | |
| mIoU improved from 0.6637 to 0.6646. | |
| --- Training --- | |
| Epoch 15 train loss: 0.4185, acc: 0.9276 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.863 | |
| mIoU improved from 0.6646 to 0.6659. | |
| --- Training --- | |
| Epoch 16 train loss: 0.4180, acc: 0.9277 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.833 | |
| --- Training --- | |
| Epoch 17 train loss: 0.4169, acc: 0.9280 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.888 | |
| mIoU improved from 0.4678 to 0.4896. | |
| --- Training --- | |
| Epoch 18 train loss: 0.4148, acc: 0.9280 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.860 | |
| --- Training --- | |
| Epoch 19 train loss: 0.4115, acc: 0.9287 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| mIoU improved from 0.6659 to 0.6689. | |
| --- Training --- | |
| Epoch 20 train loss: 0.4143, acc: 0.9282 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.877 | |
| mIoU improved from 0.6689 to 0.6700. | |
| --- Training --- | |
| Epoch 21 train loss: 0.4090, acc: 0.9291 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.873 | |
| --- Training --- | |
| Epoch 22 train loss: 0.4092, acc: 0.9291 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.867 | |
| mIoU improved from 0.6700 to 0.6722. | |
| --- Training --- | |
| Epoch 23 train loss: 0.4077, acc: 0.9295 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.874 | |
| --- Training --- | |
| Epoch 24 train loss: 0.4065, acc: 0.9296 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.867 | |
| --- Training --- | |
| Epoch 25 train loss: 0.4068, acc: 0.9296 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.868 | |
| --- Training --- | |
| Epoch 26 train loss: 0.4058, acc: 0.9295 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.872 | |
| --- Training --- | |
| Epoch 27 train loss: 0.4031, acc: 0.9302 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.884 | |
| --- Training --- | |
| Epoch 28 train loss: 0.4013, acc: 0.9305 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.882 | |
| --- Training --- | |
| Epoch 29 train loss: 0.4010, acc: 0.9304 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.883 | |
| --- Training --- | |
| Epoch 30 train loss: 0.3998, acc: 0.9306 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| --- Training --- | |
| Epoch 31 train loss: 0.3996, acc: 0.9307 | |
| --- Validation - Source --- | |
| * Acc 0.938 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| --- Training --- | |
| Epoch 32 train loss: 0.3976, acc: 0.9310 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| --- Training --- | |
| Epoch 33 train loss: 0.3950, acc: 0.9315 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.880 | |
| mIoU improved from 0.6722 to 0.6722. | |
| --- Training --- | |
| Epoch 34 train loss: 0.3954, acc: 0.9315 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.885 | |
| --- Training --- | |
| Epoch 35 train loss: 0.3947, acc: 0.9315 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.887 | |
| mIoU improved from 0.4896 to 0.4938. | |
| --- Training --- | |
| Epoch 36 train loss: 0.3951, acc: 0.9317 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.870 | |
| --- Training --- | |
| Epoch 37 train loss: 0.3972, acc: 0.9311 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.871 | |
| mIoU improved from 0.6722 to 0.6737. | |
| --- Training --- | |
| Epoch 38 train loss: 0.3928, acc: 0.9319 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.878 | |
| --- Training --- | |
| Epoch 39 train loss: 0.3942, acc: 0.9314 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.871 | |
| --- Training --- | |
| Epoch 40 train loss: 0.3903, acc: 0.9321 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| --- Training --- | |
| Epoch 41 train loss: 0.3903, acc: 0.9322 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.856 | |
| --- Training --- | |
| Epoch 42 train loss: 0.3908, acc: 0.9323 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.878 | |
| --- Training --- | |
| Epoch 43 train loss: 0.3876, acc: 0.9326 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.855 | |
| --- Training --- | |
| Epoch 44 train loss: 0.3884, acc: 0.9325 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.879 | |
| --- Training --- | |
| Epoch 45 train loss: 0.3861, acc: 0.9332 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.874 | |
| mIoU improved from 0.6737 to 0.6741. | |
| --- Training --- | |
| Epoch 46 train loss: 0.3883, acc: 0.9327 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.879 | |
| --- Training --- | |
| Epoch 47 train loss: 0.3855, acc: 0.9332 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.873 | |
| mIoU improved from 0.6741 to 0.6747. | |
| --- Training --- | |
| Epoch 48 train loss: 0.3854, acc: 0.9332 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.870 | |
| --- Training --- | |
| Epoch 49 train loss: 0.3828, acc: 0.9335 | |
| --- Validation - Source --- | |
| * Acc 0.939 | |
| --- Validation - Target --- | |
| * Acc 0.864 | |
| --- Training --- | |
| Epoch 50 train loss: 0.3830, acc: 0.9337 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.851 | |
| mIoU improved from 0.6747 to 0.6758. | |
| --- Training --- | |
| Epoch 51 train loss: 0.3821, acc: 0.9337 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| --- Training --- | |
| Epoch 52 train loss: 0.3803, acc: 0.9340 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.874 | |
| --- Training --- | |
| Epoch 53 train loss: 0.3822, acc: 0.9337 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.878 | |
| --- Training --- | |
| Epoch 54 train loss: 0.3806, acc: 0.9339 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.888 | |
| --- Training --- | |
| Epoch 55 train loss: 0.3805, acc: 0.9341 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.889 | |
| --- Training --- | |
| Epoch 56 train loss: 0.3806, acc: 0.9341 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.882 | |
| --- Training --- | |
| Epoch 57 train loss: 0.3804, acc: 0.9338 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.888 | |
| --- Training --- | |
| Epoch 58 train loss: 0.3803, acc: 0.9342 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.884 | |
| --- Training --- | |
| Epoch 59 train loss: 0.3765, acc: 0.9347 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.865 | |
| --- Training --- | |
| Epoch 60 train loss: 0.3767, acc: 0.9347 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.885 | |
| --- Training --- | |
| Epoch 61 train loss: 0.3780, acc: 0.9345 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.879 | |
| --- Training --- | |
| Epoch 62 train loss: 0.3783, acc: 0.9343 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.882 | |
| --- Training --- | |
| Epoch 63 train loss: 0.3763, acc: 0.9347 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.877 | |
| --- Training --- | |
| Epoch 64 train loss: 0.3770, acc: 0.9346 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.892 | |
| mIoU improved from 0.6758 to 0.6778. | |
| --- Training --- | |
| Epoch 65 train loss: 0.3759, acc: 0.9349 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.871 | |
| --- Training --- | |
| Epoch 66 train loss: 0.3751, acc: 0.9347 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| mIoU improved from 0.6778 to 0.6788. | |
| --- Training --- | |
| Epoch 67 train loss: 0.3750, acc: 0.9350 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.877 | |
| --- Training --- | |
| Epoch 68 train loss: 0.3746, acc: 0.9351 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| mIoU improved from 0.6788 to 0.6795. | |
| --- Training --- | |
| Epoch 69 train loss: 0.3741, acc: 0.9350 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.884 | |
| --- Training --- | |
| Epoch 70 train loss: 0.3733, acc: 0.9352 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| --- Training --- | |
| Epoch 71 train loss: 0.3741, acc: 0.9351 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.885 | |
| --- Training --- | |
| Epoch 72 train loss: 0.3711, acc: 0.9356 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.877 | |
| --- Training --- | |
| Epoch 73 train loss: 0.3717, acc: 0.9352 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.869 | |
| --- Training --- | |
| Epoch 74 train loss: 0.3720, acc: 0.9354 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.880 | |
| --- Training --- | |
| Epoch 75 train loss: 0.3728, acc: 0.9353 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.856 | |
| --- Training --- | |
| Epoch 76 train loss: 0.3731, acc: 0.9353 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| --- Training --- | |
| Epoch 77 train loss: 0.3691, acc: 0.9359 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.877 | |
| --- Training --- | |
| Epoch 78 train loss: 0.3714, acc: 0.9357 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.874 | |
| --- Training --- | |
| Epoch 79 train loss: 0.3702, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| --- Training --- | |
| Epoch 80 train loss: 0.3717, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.889 | |
| --- Training --- | |
| Epoch 81 train loss: 0.3683, acc: 0.9361 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.863 | |
| --- Training --- | |
| Epoch 82 train loss: 0.3723, acc: 0.9356 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| --- Training --- | |
| Epoch 83 train loss: 0.3688, acc: 0.9359 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.866 | |
| mIoU improved from 0.6795 to 0.6811. | |
| --- Training --- | |
| Epoch 84 train loss: 0.3697, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.885 | |
| --- Training --- | |
| Epoch 85 train loss: 0.3695, acc: 0.9357 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.882 | |
| --- Training --- | |
| Epoch 86 train loss: 0.3693, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.889 | |
| --- Training --- | |
| Epoch 87 train loss: 0.3679, acc: 0.9362 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.875 | |
| --- Training --- | |
| Epoch 88 train loss: 0.3674, acc: 0.9362 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.870 | |
| --- Training --- | |
| Epoch 89 train loss: 0.3692, acc: 0.9359 | |
| --- Validation - Source --- | |
| * Acc 0.940 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| --- Training --- | |
| Epoch 90 train loss: 0.3680, acc: 0.9361 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.872 | |
| --- Training --- | |
| Epoch 91 train loss: 0.3666, acc: 0.9362 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.878 | |
| --- Training --- | |
| Epoch 92 train loss: 0.3673, acc: 0.9362 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.864 | |
| --- Training --- | |
| Epoch 93 train loss: 0.3694, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.878 | |
| --- Training --- | |
| Epoch 94 train loss: 0.3670, acc: 0.9363 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.866 | |
| --- Training --- | |
| Epoch 95 train loss: 0.3680, acc: 0.9362 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.879 | |
| --- Training --- | |
| Epoch 96 train loss: 0.3663, acc: 0.9364 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.870 | |
| --- Training --- | |
| Epoch 97 train loss: 0.3698, acc: 0.9359 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.876 | |
| --- Training --- | |
| Epoch 98 train loss: 0.3696, acc: 0.9358 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| --- Training --- | |
| Epoch 99 train loss: 0.3666, acc: 0.9364 | |
| --- Validation - Source --- | |
| * Acc 0.941 | |
| --- Validation - Target --- | |
| * Acc 0.881 | |
| Training complete in 319m 26s | |
| Best mIoU target: 0.493756 | |