← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

On Learning the Geodesic Path for Incremental Learning CVPR 2021
Content-Aware GAN Compression CVPR 2021
Space-Time Distillation for Video Super-Resolution CVPR 2021
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NIPS 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NIPS 2020
Scalable Attentive Sentence Pair Modeling via Distilled Sentence Embedding AAAI 2020
Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation EMNLP 2020
Self-Distillation for Improving CTC-Transformer-Based ASR Systems INTERSPEECH 2020
Few Shot Network Compression via Cross Distillation AAAI 2020
Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction CONLL 2020
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation EMNLP 2020
D3D: Distilled 3D Networks for Video Action Recognition WACV 2020
Adversarial Self-Supervised Data-Free Distillation for Text Classification EMNLP 2020
Variational Learning of Bayesian Neural Networks via Bayesian Dark Knowledge IJCAI 2020
Distilling Multiple Domains for Neural Machine Translation EMNLP 2020
Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020
HW-TSC’s Participation in the WMT 2020 News Translation Shared Task EMNLP 2020
Compact Speaker Embedding: lrx-Vector INTERSPEECH 2020
Analyzing Redundancy in Pretrained Transformer Models EMNLP 2020
Distilling Structured Knowledge for Text-Based Relational Reasoning EMNLP 2020
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing EMNLP 2020
High Performance Natural Language Processing EMNLP 2020
Fast End-to-end Coreference Resolution for Korean EMNLP 2020
TinyBERT: Distilling BERT for Natural Language Understanding EMNLP 2020