Image-Text-to-Text
Transformers
Safetensors
GGUF
English
qwen2_5_vl
remyx
qwen2.5-vl
spatial-reasoning
multimodal
vlm
vqasynth
thinking
reasoning
test-time-compute
robotics
embodied-ai
quantitative-spatial-reasoning
distance-estimation
visual-question-answering
conversational
Eval Results
text-generation-inference
Update README.md
Browse files
README.md
CHANGED
@@ -18,50 +18,49 @@ tags:
|
|
18 |
- embodied-ai
|
19 |
- quantitative-spatial-reasoning
|
20 |
- distance-estimation
|
|
|
21 |
language:
|
22 |
- en
|
23 |
pipeline_tag: image-text-to-text
|
24 |
library_name: transformers
|
25 |
-
|
26 |
model-index:
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
-
|
57 |
-
|
58 |
-
|
59 |
-
|
60 |
-
|
61 |
-
|
62 |
-
|
63 |
-
|
64 |
-
|
65 |
---
|
66 |
|
67 |
|
|
|
18 |
- embodied-ai
|
19 |
- quantitative-spatial-reasoning
|
20 |
- distance-estimation
|
21 |
+
- visual-question-answering
|
22 |
language:
|
23 |
- en
|
24 |
pipeline_tag: image-text-to-text
|
25 |
library_name: transformers
|
|
|
26 |
model-index:
|
27 |
+
- name: SpaceThinker-Qwen2.5VL-3B
|
28 |
+
results:
|
29 |
+
- task:
|
30 |
+
type: visual-question-answering
|
31 |
+
name: Spatial Reasoning
|
32 |
+
dataset:
|
33 |
+
name: Q-Spatial-Bench
|
34 |
+
type: custom
|
35 |
+
metrics:
|
36 |
+
- type: success_rate
|
37 |
+
value: 0.3226
|
38 |
+
name: Overall Success Rate
|
39 |
+
results_by_distance_bucket:
|
40 |
+
- name: 0-10cm
|
41 |
+
count: 7
|
42 |
+
successes: 3
|
43 |
+
success_rate: 0.4286
|
44 |
+
- name: 10-30cm
|
45 |
+
count: 28
|
46 |
+
successes: 5
|
47 |
+
success_rate: 0.1786
|
48 |
+
- name: 30-60cm
|
49 |
+
count: 16
|
50 |
+
successes: 8
|
51 |
+
success_rate: 0.5
|
52 |
+
- name: 60-100cm
|
53 |
+
count: 17
|
54 |
+
successes: 9
|
55 |
+
success_rate: 0.5294
|
56 |
+
- name: 100-200cm
|
57 |
+
count: 19
|
58 |
+
successes: 4
|
59 |
+
success_rate: 0.2105
|
60 |
+
- name: 200cm+
|
61 |
+
count: 6
|
62 |
+
successes: 1
|
63 |
+
success_rate: 0.1667
|
|
|
64 |
---
|
65 |
|
66 |
|