DA-KD: Difficulty-Aware Knowledge Distillation for Efficient Large Language Models

Changyi He , Yifu Ding , Jinyang Guo , Ruihao Gong , Haotong Qin , Xianglong Liu