← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks COLING 2025
Who Taught You That? Tracing Teachers in Model Distillation ACL 2025
Multilingual Continual Learning using Attention Distillation COLING 2025
Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025
Inference-Time Diffusion Model Distillation ICCV 2025
GARuD: Guided Alignment of Representations using Distillation for Ultra-Low-Resource Languages IJCNLP 2025
Logic Distillation: Learning from Code Function by Function for Decision-making Tasks IJCAI 2025
SMDAF: A Scalable Sidewalk Material Data Acquisition Framework with Bidirectional Cross-Modal Knowledge Distillation WACV 2025
ChromaDistill : Colorizing Monochrome Radiance Fields with Knowledge Distillation WACV 2025
Comparative Knowledge Distillation WACV 2025
AIDE: Improving 3D Open-Vocabulary Semantic Segmentation by Aligned Vision-Language Learning WACV 2025
A Cross-Modal Densely Guided Knowledge Distillation Based on Modality Rebalancing Strategy for Enhanced Unimodal Emotion Recognition IJCAI 2025
Combining Inherent Knowledge of Vision-Language Models with Unsupervised Domain Adaptation through Strong-Weak Guidance WACV 2025
CEMIL: Contextual Attention Based Efficient Weakly Supervised Approach for Histopathology Image Classification WACV 2025
Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets WACV 2025
Single-Layer Distillation with Fourier Convolutions for Texture Anomaly Detection WACV 2025
DAM: Dynamic Adapter Merging for Continual Video QA Learning WACV 2025
MimicGait: A Model Agnostic Approach for Occluded Gait Recognition using Correlational Knowledge Distillation WACV 2025
Dropout Connects Transformers and CNNs: Transfer General Knowledge for Knowledge Distillation WACV 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025
Balancing Forget Quality and Model Utility: A Reverse KL-Divergence Knowledge Distillation Approach for Better Unlearning in LLMs NAACL 2025
Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025
SALE-MLP: Structure Aware Latent Embeddings for GNN to Graph-free MLP Distillation IJCAI 2025
Federated Low-Rank Adaptation for Foundation Models: A Survey IJCAI 2025
Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis ICCV 2025