2021 ACL ACL 2021

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains