|
BenchMark
|
|
|
|
DJCM Full Model:
|
|
|
|
8280
|
|
|
|
0.03: RPA: 95.36 RCA: 95.62 OA: 86.29
|
|
0.05: RPA: 95.27 RCA: 95.52 OA: 87.71
|
|
0.07: RPA: 95.19 RCA: 95.43 OA: 88.53
|
|
0.5: RPA: 93.7 RCA: 93.88 OA: 92.62
|
|
|
|
10738
|
|
|
|
0.03: RPA: 95.58 RCA: 95.87 OA: 75.25
|
|
0.05: RPA: 95.55 RCA: 95.83 OA: 79.0
|
|
0.07: RPA: 95.51 RCA: 95.79 OA: 81.56
|
|
0.08: RPA: 95.51 RCA: 95.78 OA: 82.54
|
|
0.5: RPA: 91.88 RCA: 92.0 OA: 91.64
|
|
|
|
DJCM Remove SVS layers:
|
|
Remove svs layers halve inference time
|
|
|
|
8280
|
|
|
|
0.03: RPA: 61.14 RCA: 65.37 OA: 59.11
|
|
0.05: RPA: 57.5 RCA: 61.01 OA: 59.95
|
|
0.07: RPA: 54.58 RCA: 57.61 OA: 59.88
|
|
0.5: RPA: 27.35 RCA: 27.84 OA: 48.04
|
|
|
|
10738
|
|
|
|
0.03: RPA: 61.14 RCA: 67.98 OA: 48.74
|
|
0.05: RPA: 59.46 RCA: 65.83 OA: 52.72
|
|
0.07: RPA: 57.27 RCA: 63.05 OA: 54.97
|
|
0.5: RPA: 20.78 RCA: 21.36 OA: 43.94 |