2021 IJCNLP IJCNLP 2021

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains