← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022
EyePAD++: A Distillation-Based Approach for Joint Eye Authentication and Presentation Attack Detection Using Periocular Images CVPR 2022
Localization Distillation for Dense Object Detection CVPR 2022
Single-Domain Generalized Object Detection in Urban Scene via Cyclic-Disentangled Self-Distillation CVPR 2022
Improving Neural Cross-Lingual Abstractive Summarization via Employing Optimal Transport Distance for Knowledge Distillation AAAI 2022
Parameter Differentiation Based Multilingual Neural Machine Translation AAAI 2022
Attention Temperature Matters in Abstractive Summarization Distillation ACL 2022
An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition ACL 2022
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022
Structured Pruning Learns Compact and Accurate Models ACL 2022
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022
Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation ACL 2022
TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge ACL 2022
Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic Samples ACL 2022
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation ACL 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks ACL 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora ACL 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers CVPR 2022
En-Compactness: Self-Distillation Embedding & Contrastive Generation for Generalized Zero-Shot Learning CVPR 2022
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection CVPR 2022
Proto2Proto: Can You Recognize the Car, the Way I Do? CVPR 2022
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection EMNLP 2022