← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

RankDistil: Knowledge Distillation for Ranking AISTATS 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation IJCNLP 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor IJCNLP 2021
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation AAAI 2021
Anycost GANs for Interactive Image Synthesis and Editing CVPR 2021
Reinforced Multi-Teacher Selection for Knowledge Distillation AAAI 2021
Flexible Non-Autoregressive Extractive Summarization with Threshold: How to Extract a Non-Fixed Number of Summary Sentences AAAI 2021
Enhanced Audio Tagging via Multi- to Single-Modal Teacher-Student Mutual Learning AAAI 2021
Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis AAAI 2021
Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures AAAI 2021
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021
Cross-Layer Distillation with Semantic Calibration AAAI 2021
Diverse Knowledge Distillation for End-to-End Person Search AAAI 2021
Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition AAAI 2021
Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021
Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation ACL 2021
BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021
Verb Knowledge Injection for Multilingual Event Processing ACL 2021
Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task ACL 2021
Real-Time Video Inference on Edge Devices via Adaptive Model Streaming ICCV 2021
Self-Mutual Distillation Learning for Continuous Sign Language Recognition ICCV 2021
PR-Net: Preference Reasoning for Personalized Video Highlight Detection ICCV 2021
Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021
Hierarchical Self-supervised Augmented Knowledge Distillation IJCAI 2021