← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
An Iterative Multi-Knowledge Transfer Network for Aspect-Based Sentiment Analysis EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
TenTrans Large-Scale Multilingual Machine Translation System for WMT21 EMNLP 2021
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge NIPS 2020
Search to Distill: Pearls Are Everywhere but Not the Eyes CVPR 2020
The Knowledge Within: Methods for Data-Free Model Compression CVPR 2020
Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction AAAI 2020
Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction CONLL 2020
Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control NIPS 2020
Multi-Agent Mutual Learning at Sentence-Level and Token-Level for Neural Machine Translation EMNLP 2020
Residual Distillation: Towards Portable Deep Neural Networks without Shortcuts NIPS 2020
Dual Policy Distillation IJCAI 2020
Sub-Band Knowledge Distillation Framework for Speech Enhancement INTERSPEECH 2020
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR INTERSPEECH 2020
Spatio-Temporal Graph for Video Captioning With Knowledge Distillation CVPR 2020
Distilling Knowledge From Graph Convolutional Networks CVPR 2020
Distilling Effective Supervision From Severe Label Noise CVPR 2020
Improving Event Detection via Open-domain Trigger Knowledge ACL 2020
Heterogeneous Knowledge Distillation Using Information Flow Modeling CVPR 2020
Adversarially Robust Distillation AAAI 2020
Robust Federated Learning via Collaborative Machine Teaching AAAI 2020
Long Short-Term Sample Distillation AAAI 2020
MTSS: Learn from Multiple Domain Teachers and Become a Multi-Domain Dialogue Expert AAAI 2020