yunfeixie commited on
Commit
33554bd
ยท
verified ยท
1 Parent(s): 3e5f4a9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-VL-7B-Instruct
4
+ language:
5
+ - en
6
+ license: apache-2.0
7
+ pipeline_tag: image-text-to-text
8
+ tags:
9
+ - transformers
10
+ - multimodal
11
+ library_name: transformers
12
+ ---
13
+
14
+ ## Model Overview
15
+
16
+ We present **Visual Game Learning (ViGaL)**, a novel post-training paradigm where multimodal large language models (MLLMs) develop out-of-domain generalization of multimodal reasoning through playing arcade-like games.
17
+
18
+ **ViGaL-7B** demonstrates that training a 7B-parameter MLLM via reinforcement learning on simple arcade-like games like Snake significantly enhances its downstream performance on multimodal math benchmarks like MathVista, and on multi-discipline questions like MMMU, **without seeing any worked solutions, equations, or diagrams during RL**, suggesting the capture of transferable reasoning skills.
19
+
20
+ ## Resources
21
+
22
+ For details of our approach and performance comparison, please see our [paper](https://arxiv.org/abs/2506.08011).
23
+
24
+ For details of training and evaluation, please see our [code repo](https://github.com/yunfeixie233/ViGaL).
25
+
26
+ | [**๐Ÿš€ Project Page**](https://yunfeixie233.github.io/ViGaL/) | [**๐Ÿ“– Paper**](https://arxiv.org/abs/2506.08011) | [**๐Ÿ”— GitHub**](https://github.com/yunfeixie233/ViGaL) | **๐Ÿค— Training Data** (Coming Soon) |
27
+
28
+
29
+ ## Citation
30
+
31
+ If you feel this model useful, please give us a free cite:
32
+ ```bibtex
33
+ @article{xie2025play,
34
+ title = {Play to Generalize: Learning to Reason Through Game Play},
35
+ author = {Xie, Yunfei and Ma, Yinsong and Lan, Shiyi and Yuille, Alan and Xiao, Junfei and Wei, Chen},
36
+ journal = {arXiv preprint arXiv:2506.08011},
37
+ year = {2025},
38
+ }
39
+ ```