← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Contact-Distil: Boosting Low Homologous Protein Contact Map Prediction by Self-Supervised Distillation AAAI 2022
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation EMNLP 2022
Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022
TrustAL: Trustworthy Active Learning Using Knowledge Distillation AAAI 2022
Language Modelling via Learning to Rank AAAI 2022
Class-Wise Adaptive Self Distillation for Federated Learning on Non-IID Data (Student Abstract) AAAI 2022
Predicting Prerequisite Relations for Unseen Concepts EMNLP 2022
Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models INTERSPEECH 2022
Multi-View Attention Transfer for Efficient Speech Enhancement INTERSPEECH 2022
Self-Supervised Models Are Continual Learners CVPR 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching NIPS 2022
Rich Feature Construction for the Optimization-Generalization Dilemma ICML 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation NAACL 2022
Re2G: Retrieve, Rerank, Generate NAACL 2022
Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022
KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
Augmented Geometric Distillation for Data-Free Incremental Person ReID CVPR 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks IJCNLP 2022
Federated Class-Incremental Learning CVPR 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022