← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020
Volctrans Parallel Corpus Filtering System for WMT 2020 EMNLP 2020
The NiuTrans System for WNGT 2020 Efficiency Task ACL 2020
Regularizing Class-Wise Predictions via Self-Knowledge Distillation CVPR 2020
Explaining Knowledge Distillation by Quantifying the Knowledge CVPR 2020
Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020
Distilling Knowledge From Graph Convolutional Networks CVPR 2020
Temporally Distributed Networks for Fast Video Semantic Segmentation CVPR 2020
Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion CVPR 2020
A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection CVPR 2020
Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation CVPR 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time ACL 2020
Efficient and High-Quality Neural Machine Translation with OpenNMT ACL 2020
Long Short-Term Sample Distillation AAAI 2020
Improved Knowledge Distillation via Teacher Assistant AAAI 2020
Stochastic Batch Augmentation with An Effective Distilled Dynamic Soft Label Regularizer IJCAI 2020
CASIA’s System for IWSLT 2020 Open Domain Translation ACL 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation INTERSPEECH 2020
Learning Student Networks with Few Data AAAI 2020
Plug-in, Trainable Gate for Streamlining Arbitrary Neural Networks AAAI 2020
Audio-Visual Model Distillation Using Acoustic Images WACV 2020
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers AAAI 2020
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation ACL 2020
Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation ACL 2020