← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition AAAI 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation AAAI 2025
Structure Balance and Gradient Matching-Based Signed Graph Condensation AAAI 2025
FVGen: Accelerating Novel-View Synthesis with Adversarial Video Diffusion Distillation ICCV 2025
HFD-Teacher: High-Frequency Depth Distillation from Depth Foundation Models for Enhanced Depth Completion ICCV 2025
EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025
EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025
MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
Dual Information Purification for Lightweight SAR Object Detection AAAI 2025
Can We Achieve Efficient Diffusion Without Self-Attention? Distilling Self-Attention into Convolutions ICCV 2025
ConDo: Continual Domain Expansion for Absolute Pose Regression AAAI 2025
Sparse Fine-Tuning of Transformers for Generative Tasks ICCV 2025
Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025
Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025
CARMO: Dynamic Criteria Generation for Context Aware Reward Modelling ACL 2025
A Knowledge Distillation-Based Approach to Enhance Transparency of Classifier Models AAAI 2025
SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection AAAI 2025
KDAT: Inherent Adversarial Robustness via Knowledge Distillation with Adversarial Tuning for Object Detection Models AAAI 2025
CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025
Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025
Dynamic Expansion Diffusion Learning for Lifelong Generative Modelling AAAI 2025