← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

CompRess: Self-Supervised Learning by Compressing Representations NIPS 2020
SimulSpeech: End-to-End Simultaneous Speech to Text Translation ACL 2020
Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness ACL 2020
Improving Event Detection via Open-domain Trigger Knowledge ACL 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing ACL 2020
DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020
Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020
Adversarially Robust Distillation AAAI 2020
Response-Anticipated Memory for On-Demand Knowledge Integration in Response Generation ACL 2020
Improving Non-autoregressive Neural Machine Translation with Monolingual Data ACL 2020
Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020
Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020
Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020
Self-Training With Noisy Student Improves ImageNet Classification CVPR 2020
Dual Policy Distillation IJCAI 2020
Heterogeneous Knowledge Distillation Using Information Flow Modeling CVPR 2020
ADINet: Attribute Driven Incremental Network for Retinal Image Classification CVPR 2020
Distilling Image Dehazing With Heterogeneous Task Imitation CVPR 2020
Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers EMNLP 2020
Amalgamating Knowledge from Two Teachers for Task-oriented Dialogue System with Adversarial Training EMNLP 2020
Learning Metrics From Teachers: Compact Networks for Image Embedding CVPR 2019
Distilling Policy Distillation AISTATS 2019
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More CVPR 2019
Structured Knowledge Distillation for Semantic Segmentation CVPR 2019
Unified Semantic Parsing with Weak Supervision ACL 2019