← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Personalized Image Privacy Advisors via Federated Daisy-Chaining WACV 2026
MVAT: Multi-View Aware Teacher for Weakly Supervised 3D Object Detection WACV 2026
Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance AAAI 2025
You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025
RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion ICCV 2025
KDAT: Inherent Adversarial Robustness via Knowledge Distillation with Adversarial Tuning for Object Detection Models AAAI 2025
MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025
Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
HFD-Teacher: High-Frequency Depth Distillation from Depth Foundation Models for Enhanced Depth Completion ICCV 2025
EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025
Sparse Fine-Tuning of Transformers for Generative Tasks ICCV 2025
Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025
FVGen: Accelerating Novel-View Synthesis with Adversarial Video Diffusion Distillation ICCV 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025
EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025
A4A: Adapter for Adapter Transfer via All-for-All Mapping for Cross-Architecture Models CVPR 2025
Label Augmented Dataset Distillation WACV 2025
Distilling Aggregated Knowledge for Weakly-Supervised Video Anomaly Detection WACV 2025
Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence NAACL 2025
Who Taught You That? Tracing Teachers in Model Distillation ACL 2025
Can We Achieve Efficient Diffusion Without Self-Attention? Distilling Self-Attention into Convolutions ICCV 2025
DASK: Distribution Rehearsing via Adaptive Style Kernel Learning for Exemplar-Free Lifelong Person Re-Identification AAAI 2025