← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Dense Interspecies Face Embedding NIPS 2022
Rethinking Resolution in the Context of Efficient Video Recognition NIPS 2022
Future-Guided Incremental Transformer for Simultaneous Translation AAAI 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation CVPR 2021
Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner CVPR 2021
A Peek Into the Reasoning of Neural Networks: Interpreting With Structural Visual Concepts CVPR 2021
Parser-Free Virtual Try-On via Distilling Appearance Flows CVPR 2021
Complementary Relation Contrastive Distillation CVPR 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
The Mininglamp Machine Translation System for WMT21 EMNLP 2021
Small Model and In-Domain Data Are All You Need EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding EMNLP 2021
Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation EMNLP 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation EMNLP 2021
Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021
deepQuest-py: Large and Distilled Models for Quality Estimation EMNLP 2021
Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021
Probabilistic Model Distillation for Semantic Correspondence CVPR 2021
When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks CVPR 2021
Learning Student Networks in the Wild CVPR 2021
Distilling Knowledge via Knowledge Review CVPR 2021
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification CVPR 2021
There Is More Than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking With Sound by Distilling Multimodal Knowledge CVPR 2021