← Back to papers
2021 ACL ACL 2021

MergeDistill: Merging Language Models using Pre-trained Distillation

Authors

Simran Khanuja , Melvin Johnson , Partha Talukdar
Download PDF

Related papers

Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training 2021
A Non-Autoregressive Edit-Based Approach to Controllable Text Simplification 2021
How Did This Get Funded?! Automatically Identifying Quirky Scientific Achievements 2021
Exploring Discourse Structures for Argument Impact Classification 2021
Language Embeddings for Typology and Cross-lingual Transfer Learning 2021