README.md

---
license: apache-2.0
base_model:
- Qwen/Qwen3-4B-Base
---

# Spiral-Qwen3-4B

## Links

- 📜 [Paper](https://huggingface.co/papers/2506.24119)
- 💻 [GitHub](https://github.com/spiral-rl/spiral)
- 🤗 [Spiral Collection](https://huggingface.co/collections/spiral-rl/spiral-68627f14c250c3cc1fdbf6fe)

## Introduction

This model is trained with self-play on multi-games (TicTacToe, Kuhn Poker, Simple Negotiation) using the SPIRAL framework.

<img src="https://raw.githubusercontent.com/spiral-rl/spiral/refs/heads/main/assets/framework.png" width=100%/>


## Citation

```latex
@article{liu2025spiral,
  title={SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning},
  author={Liu, Bo and Guertler, Leon and Yu, Simon and Liu, Zichen and Qi, Penghui and Balcells, Daniel and Liu, Mickel and Tan, Cheston and Shi, Weiyan and Lin, Min and Lee, Wee Sun and Jaques, Natasha},
  year={2025},
  journal={arXiv preprint arXiv:2506.24119},
  url={https://arxiv.org/abs/2506.24119}
}
```