Structural Self-Supervised Objectives for Transformers
Paper
•
2309.08272
•
Published
Luca Di Liello
lucadiliello
AI & ML interests
Applied Scientist II in Amazon AGI
Recent Activity
upvoted
an
article
15 days ago
quanto: a pytorch quantization toolkit
liked
a model
about 1 month ago
OpenGVLab/InternVL3-8B-Instruct
liked
a dataset
about 1 month ago
UCSC-VLAA/Recap-DataComp-1B
Organizations
None yet
authored
6
papers
over 1 year ago
Efficient Generation of Structured Objects with Constrained Adversarial Networks
Paper
•
2007.13197
•
Published
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
Paper
•
2205.10455
•
Published
Paragraph-based Transformer Pre-training for Multi-Sentence Inference
Paper
•
2205.01228
•
Published
Context-Aware Transformer Pre-Training for Answer Sentence Selection
Paper
•
2305.15358
•
Published
Efficient pre-training objectives for Transformers
Paper
•
2104.09694
•
Published