Dual Modalities of Text: Visual and Textual Generative Pre-training
Paper
•
2404.10710
•
Published
Pixel-based Pre-training (PixelGPT)
[EMNLP'24] [Autoregressive Pre-Training on Pixels and Texts](https://arxiv.org/pdf/2404.10710).