← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud CVPR 2021
Wasserstein Contrastive Representation Distillation CVPR 2021
Unbiased Mean Teacher for Cross-Domain Object Detection CVPR 2021
PLOP: Learning Without Forgetting for Continual Semantic Segmentation CVPR 2021
Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation EMNLP 2021
GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking EMNLP 2021
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains ACL 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor ACL 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task ACL 2021
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation INTERSPEECH 2021
CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition INTERSPEECH 2021
Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation INTERSPEECH 2021
Structural Adapters in Pretrained Language Models for AMR-to-Text Generation EMNLP 2021
GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks EMNLP 2021
Finetuning Pretrained Transformers into RNNs EMNLP 2021
N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021
Distilling Knowledge for Empathy Detection EMNLP 2021
Adam Mickiewicz University’s English-Hausa Submissions to the WMT 2021 News Translation Task EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation WACV 2021
CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks NIPS 2021
Distilling Meta Knowledge on Heterogeneous Graph for Illicit Drug Trafficker Detection on Social Media NIPS 2021
3D-to-2D Distillation for Indoor Scene Parsing CVPR 2021