← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021
Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias EMNLP 2021
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021
NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
Joint-DetNAS: Upgrade Your Detector With NAS, Pruning and Dynamic Distillation CVPR 2021
Zoo-Tuning: Adaptive Transfer from A Zoo of Models ICML 2021
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ACL 2021
Selective Knowledge Distillation for Neural Machine Translation ACL 2021
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism ACL 2021
Learning to Explain: Generating Stable Explanations Fast ACL 2021
Obtaining Better Static Word Embeddings Using Contextual Embedding Models ACL 2021
Meta Pseudo Labels CVPR 2021
EvDistill: Asynchronous Events To End-Task Learning via Bidirectional Reconstruction-Guided Cross-Modal Knowledge Distillation CVPR 2021
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation CVPR 2021
Amalgamating Knowledge From Heterogeneous Graph Neural Networks CVPR 2021
Revisiting Knowledge Distillation: An Inheritance and Exploration Framework CVPR 2021
Knowledge Evolution in Neural Networks CVPR 2021
Fair Feature Distillation for Visual Recognition CVPR 2021
Asymmetric Metric Learning for Knowledge Transfer CVPR 2021
Data-Free Model Extraction CVPR 2021
Content-Aware GAN Compression CVPR 2021
Tree-Like Decision Distillation CVPR 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution CVPR 2021