← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

General Instance Distillation for Object Detection CVPR 2021
Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021
Ego-Exo: Transferring Visual Representations From Third-Person to First-Person Videos CVPR 2021
Positive-Unlabeled Data Purification in the Wild for Object Detection CVPR 2021
Complementary Relation Contrastive Distillation CVPR 2021
SuperMix: Supervising the Mixing Data Augmentation CVPR 2021
Distilling Knowledge via Knowledge Review CVPR 2021
Learning Student Networks in the Wild CVPR 2021
Claim Matching Beyond English to Scale Global Fact-Checking ACL 2021
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains IJCNLP 2021
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation ACL 2021
3D-to-2D Distillation for Indoor Scene Parsing CVPR 2021
Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation NIPS 2021
Learning Student-Friendly Teacher Networks for Knowledge Distillation NIPS 2021
Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NIPS 2021
Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework NIPS 2021
Instance-Conditional Knowledge Distillation for Object Detection NIPS 2021
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing NIPS 2021
Speech Emotion Recognition via Multi-Level Cross-Modal Distillation INTERSPEECH 2021
Online Multi-Granularity Distillation for GAN Compression ICCV 2021
Deep Structured Instance Graph for Distilling Object Detectors ICCV 2021
Improved Knowledge Distillation via Teacher Assistant AAAI 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition EMNLP 2020
Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast—Choose Three EMNLP 2020