← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Learning End-to-End Scene Flow by Distilling Single Tasks Knowledge AAAI 2020
Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction AAAI 2020
Towards Making the Most of BERT in Neural Machine Translation AAAI 2020
Acquiring Knowledge from Pre-Trained Model to Neural Machine Translation AAAI 2020
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers AAAI 2020
Partial Label Learning with Batch Label Correction AAAI 2020
Light Multi-Segment Activation for Model Compression AAAI 2020
Ultrafast Video Attention Prediction with Coupled Knowledge Distillation AAAI 2020
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition AAAI 2020
Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification AAAI 2020
Hierarchical Knowledge Squeezed Adversarial Network Compression AAAI 2020
Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization AAAI 2020
Exploit and Replace: An Asymmetrical Two-Stream Architecture for Versatile Light Field Saliency Detection AAAI 2020
Knowledge Integration Networks for Action Recognition AAAI 2020
Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020
DFQF: Data Free Quantization-aware Fine-tuning ACML 2020
Self-Distillation for Improving CTC-Transformer-Based ASR Systems INTERSPEECH 2020
Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion CVPR 2020
Multi-label Contrastive Predictive Coding NIPS 2020
Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation NIPS 2020
Towards Oracle Knowledge Distillation with Neural Architecture Search AAAI 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Online Knowledge Distillation with Diverse Peers AAAI 2020
Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation AAAI 2020
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space NIPS 2020