Pretraining

ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding

Cross-modal pretraining of speech and text for end-to-end spoken language understanding via masked and conditioned cross-modal language modeling - ___[ICASSP 2021](https://2021.ieeeicassp.org)___