← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models IJCAI 2024
UniADS: Universal Architecture-Distiller Search for Distillation Gap AAAI 2024
Layer Compression of Deep Networks with Straight Flows AAAI 2024
Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold AAAI 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024
Variational Distillation of Diffusion Policies into Mixture of Experts NIPS 2024
Cross-modal Representation Flattening for Multi-modal Domain Generalization NIPS 2024
Object Attribute Matters in Visual Question Answering AAAI 2024
MIND: Multi-Task Incremental Network Distillation AAAI 2024
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation AAAI 2024
DistilVPR: Cross-Modal Knowledge Distillation for Visual Place Recognition AAAI 2024
Progressive Distillation Based on Masked Generation Feature Method for Knowledge Graph Completion AAAI 2024
Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion EMNLP 2024
MGCL: Multi-Granularity Clue Learning for Emotion-Cause Pair Extraction via Cross-Grained Knowledge Distillation EMNLP 2024
Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning AAAI 2024
SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation EMNLP 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024
Asymmetric Masked Distillation for Pre-Training Small Foundation Models CVPR 2024
XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning AAAI 2024
Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024
CLIP-Guided Federated Learning on Heterogeneity and Long-Tailed Data AAAI 2024
CLIP-KD: An Empirical Study of CLIP Model Distillation CVPR 2024
Transformer as Linear Expansion of Learngene AAAI 2024
Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024
PairDistill: Pairwise Relevance Distillation for Dense Retrieval EMNLP 2024