V-STaR-LeaderBoard / leaderboard_chain1.csv
lwpyh's picture
Upload 4 files
4fba015 verified
Model,LGM,AM,Score,Acc,R1@0.3,R1@0.5, R1@0.7, m_tIoU,AP@0.1,AP@0.3,AP@0.5,m_vIoU
GPT-4o,39.51,27.97,1.71,60.78,23.14,10.35,5.1,16.67,19.92,8.36,2.75,6.47
Gemini-2-Flash,36.14,27.39,1.59,53.01,31.63,15.84,9.45,24.54,15.67,3.82,0.93,4.63
Qwen2.5-VL,35.2,26.53,1.61,54.53,17.03,8.92,3.72,11.48,35.89,19.92,8.36,13.59
Video-CCAM-v1.2,30.51,20.28,1.75,59.35,1.15,0,0,1.5,0,0,0,0
Video-Llama3,27.12,21.93,1.38,41.94,35.73,19.8,8.68,22.97,3.17,0.76,0.11,0.89
Llava-Video,27.11,20.64,1.5,49.48,15.12,6.3,1.43,10.52,5.23,0.94,0.18,1.92
VTimeLLM,24.18,19.6,1.45,41.46,25.24,10.88,3.15,17.13,0.62,0.14,0.03,0.21
InternVL-2.5,22.69,17.85,1.46,44.18,11.98,4.87,2.34,8.72,2.18,0.27,0.04,0.65
VideoChat2,20.74,17.47,1.27,36.21,20.47,13.07,6.49,13.69,10.06,1.31,0.14,2.51
Qwen2-VL,20.35,18.13,1.03,25.91,27.96,17.94,9.16,19.18,28.59,12.21,3.89,9.31
Sa2VA,19,16.26,0.7,16.36,0.1,0,0,0.11,52.16,42.68,34.18,32.31
Oryx-1.5,16.05,14.72,0.94,20.47,17.03,4.48,1.72,13.54,35.58,11.6,2.17,10.14
TimeChat,14.47,12.8,1.06,26.38,17.8,8.68,3.48,12.01,0,0,0,0
TRACE,13.78,12.45,0.9,17.6,28.53,14.17,6.73,19.74,0,0,0,0