← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Investigating Adapters for Parameter-efficient Low-resource Automatic Speech Recognition NAACL 2025
Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025
Disentangling Spatio-Temporal Knowledge for Weakly Supervised Object Detection and Segmentation in Surgical Video WACV 2025
3D Denoisers Are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation AAAI 2025
Combining Inherent Knowledge of Vision-Language Models with Unsupervised Domain Adaptation through Strong-Weak Guidance WACV 2025
Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration AAAI 2025
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025
EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies WACV 2024
Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024
StyleGAN-Fusion: Diffusion Guided Domain Adaptation of Image Generators WACV 2024
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning ACL 2024
To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking CVPR 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024
Token-wise Influential Training Data Retrieval for Large Language Models ACL 2024
Efficient Stitchable Task Adaptation CVPR 2024
Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA ACL 2024
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams NIPS 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024
Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models IJCAI 2024
Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages ACL 2024
Reviewing the Forgotten Classes for Domain Adaptation of Black-Box Predictors AAAI 2024