← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Distilling Knowledge for Search-based Structured Prediction ACL 2018
Neural Natural Language Inference Models Enhanced with External Knowledge ACL 2018
KDGAN: Knowledge Distillation with Generative Adversarial Networks NIPS 2018
Knowledge Distillation by On-the-Fly Native Ensemble NIPS 2018
Knowledge Distillation for Sequence Model INTERSPEECH 2018
Born Again Neural Networks ICML 2018
Revisiting the Importance of Encoding Logic Rules in Sentiment Classification EMNLP 2018
Analyzing Knowledge Distillation in Neural Machine Translation EMNLP 2018
NestedNet: Learning Nested Sparse Structures in Deep Neural Networks CVPR 2018
A Gift From Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning CVPR 2017
Cross-lingual Distillation for Text Classification ACL 2017
Learning Efficient Object Detection Models with Knowledge Distillation NIPS 2017
Robust Speech Recognition Using Generalized Distillation Framework INTERSPEECH 2016
Cross Modal Distillation for Supervision Transfer CVPR 2016
Do Deep Nets Really Need to be Deep? NIPS 2014