← Back to papers
2021 ACL ACL 2021

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers

Authors

Wenhui Wang , Hangbo Bao , Shaohan Huang , Li Dong , Furu Wei
Download PDF

Related papers

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training 2021
A Non-Autoregressive Edit-Based Approach to Controllable Text Simplification 2021
How Did This Get Funded?! Automatically Identifying Quirky Scientific Achievements 2021
Exploring Discourse Structures for Argument Impact Classification 2021
Language Embeddings for Typology and Cross-lingual Transfer Learning 2021