SDGPA / night1 /log.txt
roujin's picture
init
44a8b4b verified
Model pushed to 1 GPU(s), type NVIDIA GeForce RTX 3090.
--- Training ---
Epoch 0 train loss: 1.6323, acc: 0.7784
--- Validation - Source ---
* Acc 0.868
--- Validation - Target ---
* Acc 0.571
mIoU improved from 0.0000 to 0.1268.
mIoU improved from 0.0000 to 0.3292.
--- Training ---
Epoch 1 train loss: 1.0310, acc: 0.8531
--- Validation - Source ---
* Acc 0.887
--- Validation - Target ---
* Acc 0.561
mIoU improved from 0.1268 to 0.1308.
mIoU improved from 0.3292 to 0.4221.
--- Training ---
Epoch 2 train loss: 0.9083, acc: 0.8684
--- Validation - Source ---
* Acc 0.897
--- Validation - Target ---
* Acc 0.591
mIoU improved from 0.1308 to 0.1604.
mIoU improved from 0.4221 to 0.4725.
--- Training ---
Epoch 3 train loss: 0.8362, acc: 0.8781
--- Validation - Source ---
* Acc 0.900
--- Validation - Target ---
* Acc 0.603
mIoU improved from 0.1604 to 0.1892.
mIoU improved from 0.4725 to 0.4981.
--- Training ---
Epoch 4 train loss: 0.7814, acc: 0.8858
--- Validation - Source ---
* Acc 0.907
--- Validation - Target ---
* Acc 0.600
mIoU improved from 0.4981 to 0.5149.
--- Training ---
Epoch 5 train loss: 0.7457, acc: 0.8911
--- Validation - Source ---
* Acc 0.909
--- Validation - Target ---
* Acc 0.601
mIoU improved from 0.5149 to 0.5313.
--- Training ---
Epoch 6 train loss: 0.7142, acc: 0.8952
--- Validation - Source ---
* Acc 0.911
--- Validation - Target ---
* Acc 0.604
mIoU improved from 0.5313 to 0.5399.
--- Training ---
Epoch 7 train loss: 0.6873, acc: 0.8989
--- Validation - Source ---
* Acc 0.911
--- Validation - Target ---
* Acc 0.597
mIoU improved from 0.5399 to 0.5421.
--- Training ---
Epoch 8 train loss: 0.6670, acc: 0.9015
--- Validation - Source ---
* Acc 0.914
--- Validation - Target ---
* Acc 0.622
mIoU improved from 0.1892 to 0.2168.
mIoU improved from 0.5421 to 0.5524.
--- Training ---
Epoch 9 train loss: 0.6550, acc: 0.9036
--- Validation - Source ---
* Acc 0.916
--- Validation - Target ---
* Acc 0.619
mIoU improved from 0.5524 to 0.5575.
--- Training ---
Epoch 10 train loss: 0.6321, acc: 0.9069
--- Validation - Source ---
* Acc 0.916
--- Validation - Target ---
* Acc 0.605
mIoU improved from 0.5575 to 0.5700.
--- Training ---
Epoch 11 train loss: 0.6253, acc: 0.9077
--- Validation - Source ---
* Acc 0.918
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.2168 to 0.2226.
--- Training ---
Epoch 12 train loss: 0.6088, acc: 0.9102
--- Validation - Source ---
* Acc 0.919
--- Validation - Target ---
* Acc 0.595
mIoU improved from 0.5700 to 0.5770.
--- Training ---
Epoch 13 train loss: 0.5971, acc: 0.9119
--- Validation - Source ---
* Acc 0.919
--- Validation - Target ---
* Acc 0.611
mIoU improved from 0.2226 to 0.2235.
--- Training ---
Epoch 14 train loss: 0.5864, acc: 0.9132
--- Validation - Source ---
* Acc 0.920
--- Validation - Target ---
* Acc 0.619
mIoU improved from 0.2235 to 0.2267.
mIoU improved from 0.5770 to 0.5831.
--- Training ---
Epoch 15 train loss: 0.5795, acc: 0.9143
--- Validation - Source ---
* Acc 0.921
--- Validation - Target ---
* Acc 0.601
mIoU improved from 0.5831 to 0.5839.
--- Training ---
Epoch 16 train loss: 0.5737, acc: 0.9155
--- Validation - Source ---
* Acc 0.921
--- Validation - Target ---
* Acc 0.605
mIoU improved from 0.5839 to 0.5848.
--- Training ---
Epoch 17 train loss: 0.5671, acc: 0.9159
--- Validation - Source ---
* Acc 0.922
--- Validation - Target ---
* Acc 0.607
mIoU improved from 0.5848 to 0.5923.
--- Training ---
Epoch 18 train loss: 0.5551, acc: 0.9174
--- Validation - Source ---
* Acc 0.923
--- Validation - Target ---
* Acc 0.611
mIoU improved from 0.5923 to 0.5944.
--- Training ---
Epoch 19 train loss: 0.5487, acc: 0.9186
--- Validation - Source ---
* Acc 0.923
--- Validation - Target ---
* Acc 0.620
mIoU improved from 0.2267 to 0.2384.
mIoU improved from 0.5944 to 0.6010.
--- Training ---
Epoch 20 train loss: 0.5441, acc: 0.9190
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.615
mIoU improved from 0.6010 to 0.6094.
--- Training ---
Epoch 21 train loss: 0.5363, acc: 0.9205
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6094 to 0.6108.
--- Training ---
Epoch 22 train loss: 0.5342, acc: 0.9206
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6108 to 0.6156.
--- Training ---
Epoch 23 train loss: 0.5247, acc: 0.9222
--- Validation - Source ---
* Acc 0.927
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6156 to 0.6164.
--- Training ---
Epoch 24 train loss: 0.5235, acc: 0.9225
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 25 train loss: 0.5218, acc: 0.9225
--- Validation - Source ---
* Acc 0.927
--- Validation - Target ---
* Acc 0.615
mIoU improved from 0.6164 to 0.6177.
--- Training ---
Epoch 26 train loss: 0.5149, acc: 0.9237
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 27 train loss: 0.5096, acc: 0.9242
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.616
mIoU improved from 0.2384 to 0.2388.
mIoU improved from 0.6177 to 0.6200.
--- Training ---
Epoch 28 train loss: 0.5046, acc: 0.9249
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.609
--- Training ---
Epoch 29 train loss: 0.5031, acc: 0.9250
--- Validation - Source ---
* Acc 0.927
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6200 to 0.6222.
--- Training ---
Epoch 30 train loss: 0.4976, acc: 0.9257
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.615
mIoU improved from 0.6222 to 0.6246.
--- Training ---
Epoch 31 train loss: 0.4945, acc: 0.9263
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.621
mIoU improved from 0.2388 to 0.2455.
mIoU improved from 0.6246 to 0.6259.
--- Training ---
Epoch 32 train loss: 0.4942, acc: 0.9262
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.600
--- Training ---
Epoch 33 train loss: 0.4876, acc: 0.9273
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.624
mIoU improved from 0.6259 to 0.6314.
--- Training ---
Epoch 34 train loss: 0.4848, acc: 0.9277
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 35 train loss: 0.4843, acc: 0.9278
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.623
mIoU improved from 0.2455 to 0.2460.
mIoU improved from 0.6314 to 0.6329.
--- Training ---
Epoch 36 train loss: 0.4818, acc: 0.9283
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.624
--- Training ---
Epoch 37 train loss: 0.4826, acc: 0.9282
--- Validation - Source ---
* Acc 0.931
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6329 to 0.6353.
--- Training ---
Epoch 38 train loss: 0.4757, acc: 0.9286
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.620
--- Training ---
Epoch 39 train loss: 0.4755, acc: 0.9289
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.608
mIoU improved from 0.6353 to 0.6407.
--- Training ---
Epoch 40 train loss: 0.4719, acc: 0.9297
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.618
--- Training ---
Epoch 41 train loss: 0.4672, acc: 0.9300
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.623
--- Training ---
Epoch 42 train loss: 0.4692, acc: 0.9303
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.621
mIoU improved from 0.2460 to 0.2468.
--- Training ---
Epoch 43 train loss: 0.4627, acc: 0.9308
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.618
mIoU improved from 0.2468 to 0.2486.
mIoU improved from 0.6407 to 0.6410.
--- Training ---
Epoch 44 train loss: 0.4614, acc: 0.9309
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.620
mIoU improved from 0.6410 to 0.6429.
--- Training ---
Epoch 45 train loss: 0.4597, acc: 0.9313
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.615
--- Training ---
Epoch 46 train loss: 0.4609, acc: 0.9309
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 47 train loss: 0.4593, acc: 0.9314
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.612
mIoU improved from 0.6429 to 0.6429.
--- Training ---
Epoch 48 train loss: 0.4557, acc: 0.9316
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.619
--- Training ---
Epoch 49 train loss: 0.4520, acc: 0.9325
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 50 train loss: 0.4512, acc: 0.9321
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.614
mIoU improved from 0.6429 to 0.6446.
--- Training ---
Epoch 51 train loss: 0.4480, acc: 0.9331
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.621
mIoU improved from 0.6446 to 0.6476.
--- Training ---
Epoch 52 train loss: 0.4483, acc: 0.9330
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.612
--- Training ---
Epoch 53 train loss: 0.4493, acc: 0.9327
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.615
mIoU improved from 0.2486 to 0.2489.
--- Training ---
Epoch 54 train loss: 0.4443, acc: 0.9334
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.617
mIoU improved from 0.6476 to 0.6496.
--- Training ---
Epoch 55 train loss: 0.4434, acc: 0.9337
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.616
--- Training ---
Epoch 56 train loss: 0.4442, acc: 0.9333
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.617
mIoU improved from 0.2489 to 0.2578.
--- Training ---
Epoch 57 train loss: 0.4420, acc: 0.9336
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.614
--- Training ---
Epoch 58 train loss: 0.4407, acc: 0.9338
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.621
mIoU improved from 0.6496 to 0.6520.
--- Training ---
Epoch 59 train loss: 0.4369, acc: 0.9345
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.611
mIoU improved from 0.6520 to 0.6525.
--- Training ---
Epoch 60 train loss: 0.4367, acc: 0.9345
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.624
--- Training ---
Epoch 61 train loss: 0.4378, acc: 0.9344
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.616
--- Training ---
Epoch 62 train loss: 0.4362, acc: 0.9345
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.613
mIoU improved from 0.6525 to 0.6549.
--- Training ---
Epoch 63 train loss: 0.4347, acc: 0.9348
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.626
--- Training ---
Epoch 64 train loss: 0.4344, acc: 0.9346
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.629
mIoU improved from 0.2578 to 0.2585.
mIoU improved from 0.6549 to 0.6573.
--- Training ---
Epoch 65 train loss: 0.4328, acc: 0.9350
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.617
--- Training ---
Epoch 66 train loss: 0.4301, acc: 0.9353
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.609
--- Training ---
Epoch 67 train loss: 0.4303, acc: 0.9356
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.611
--- Training ---
Epoch 68 train loss: 0.4294, acc: 0.9357
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.619
mIoU improved from 0.6573 to 0.6580.
--- Training ---
Epoch 69 train loss: 0.4293, acc: 0.9357
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
--- Training ---
Epoch 70 train loss: 0.4287, acc: 0.9357
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.617
--- Training ---
Epoch 71 train loss: 0.4280, acc: 0.9358
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.621
--- Training ---
Epoch 72 train loss: 0.4256, acc: 0.9361
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.617
--- Training ---
Epoch 73 train loss: 0.4248, acc: 0.9361
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.610
--- Training ---
Epoch 74 train loss: 0.4252, acc: 0.9361
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.621
--- Training ---
Epoch 75 train loss: 0.4247, acc: 0.9361
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.610
mIoU improved from 0.6580 to 0.6591.
--- Training ---
Epoch 76 train loss: 0.4262, acc: 0.9361
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.620
--- Training ---
Epoch 77 train loss: 0.4200, acc: 0.9368
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.619
--- Training ---
Epoch 78 train loss: 0.4217, acc: 0.9364
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
--- Training ---
Epoch 79 train loss: 0.4236, acc: 0.9362
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
mIoU improved from 0.2585 to 0.2597.
mIoU improved from 0.6591 to 0.6592.
--- Training ---
Epoch 80 train loss: 0.4210, acc: 0.9367
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.622
--- Training ---
Epoch 81 train loss: 0.4168, acc: 0.9370
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.616
--- Training ---
Epoch 82 train loss: 0.4211, acc: 0.9370
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.621
mIoU improved from 0.6592 to 0.6612.
--- Training ---
Epoch 83 train loss: 0.4178, acc: 0.9371
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.616
--- Training ---
Epoch 84 train loss: 0.4195, acc: 0.9369
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.618
--- Training ---
Epoch 85 train loss: 0.4181, acc: 0.9371
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.617
--- Training ---
Epoch 86 train loss: 0.4174, acc: 0.9370
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.620
--- Training ---
Epoch 87 train loss: 0.4156, acc: 0.9375
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
--- Training ---
Epoch 88 train loss: 0.4150, acc: 0.9375
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
mIoU improved from 0.6612 to 0.6615.
--- Training ---
Epoch 89 train loss: 0.4160, acc: 0.9374
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.613
--- Training ---
Epoch 90 train loss: 0.4165, acc: 0.9373
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.619
mIoU improved from 0.6615 to 0.6627.
--- Training ---
Epoch 91 train loss: 0.4135, acc: 0.9375
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.618
--- Training ---
Epoch 92 train loss: 0.4167, acc: 0.9372
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.613
--- Training ---
Epoch 93 train loss: 0.4162, acc: 0.9374
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.621
--- Training ---
Epoch 94 train loss: 0.4131, acc: 0.9377
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.620
--- Training ---
Epoch 95 train loss: 0.4145, acc: 0.9375
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.620
--- Training ---
Epoch 96 train loss: 0.4131, acc: 0.9380
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.615
--- Training ---
Epoch 97 train loss: 0.4172, acc: 0.9372
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.618
--- Training ---
Epoch 98 train loss: 0.4172, acc: 0.9372
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.623
--- Training ---
Epoch 99 train loss: 0.4134, acc: 0.9378
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.617
Training complete in 659m 4s
Best mIoU target: 0.259692