← Core AI
Artificial Intelligence › Core AI ›

Knowledge Distillation

99 directly classified papers

Papers per year

Papers

Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models EMNLP 2023
StructVPR: Distill Structural Knowledge With Weighting Samples for Visual Place Recognition CVPR 2023
LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation CVPR 2023
Instance Relation Graph Guided Source-Free Domain Adaptive Object Detection CVPR 2023
DiGA: Distil To Generalize and Then Adapt for Domain Adaptive Semantic Segmentation CVPR 2023
Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation ACL 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix EMNLP 2023
Watermarking PLMs on Classification Tasks by Combining Contrastive Learning with Weight Perturbation EMNLP 2023
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023
STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection NIPS 2023
Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks NIPS 2023
Knowledge Distillation via the Target-Aware Transformer CVPR 2022
Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection EMNLP 2022
Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022
BERT Learns to Teach: Knowledge Distillation with Meta Learning ACL 2022
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022
HyperInverter: Improving StyleGAN Inversion via Hypernetwork CVPR 2022
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation EMNLP 2022
The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022
Calibrating Student Models for Emotion-related Tasks EMNLP 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022
Distilling Multilingual Transformers into CNNs for Scalable Intent Classification EMNLP 2022
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021