DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT Paper • 2110.01900 • Published Oct 5, 2021
SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model Paper • 2210.00705 • Published Oct 3, 2022
USAD: Universal Speech and Audio Representation via Distillation Paper • 2506.18843 • Published 3 days ago • 10
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning Paper • 2305.10005 • Published May 17, 2023 • 3