← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Knowledge Distillation from Offline to Streaming RNN Transducer for End-to-End Speech Recognition INTERSPEECH 2020
Sub-Band Knowledge Distillation Framework for Speech Enhancement INTERSPEECH 2020
Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription INTERSPEECH 2020
Conditional Response Augmentation for Dialogue Using Knowledge Distillation INTERSPEECH 2020
Ensemble Approaches for Uncertainty in Spoken Language Assessment INTERSPEECH 2020
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR INTERSPEECH 2020
StrawNet: Self-Training WaveNet for TTS in Low-Data Regimes INTERSPEECH 2020
Learning End-to-End Scene Flow by Distilling Single Tasks Knowledge AAAI 2020
Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue EMNLP 2020
Lifelong Language Knowledge Distillation EMNLP 2020
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance EMNLP 2020
Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives CVPR 2020
Structured Multi-Hashing for Model Compression CVPR 2020
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons AAAI 2019
PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation ACL 2019
Unifying Heterogeneous Classifiers With Distillation CVPR 2019
AWSD: Adaptive Weighted Spatiotemporal Distillation for Video Representation ICCV 2019
Efficient Video Classification Using Fewer Frames CVPR 2019
Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition With Multimodal Training CVPR 2019
Distilled Person Re-Identification: Towards a More Scalable System CVPR 2019
Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019
Geometry-Aware Distillation for Indoor Semantic Segmentation CVPR 2019
Relational Knowledge Distillation CVPR 2019
Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-Grained Image Recognition CVPR 2019