← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025
Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025
Distilling Aggregated Knowledge for Weakly-Supervised Video Anomaly Detection WACV 2025
Label Augmented Dataset Distillation WACV 2025
CARMO: Dynamic Criteria Generation for Context Aware Reward Modelling ACL 2025
ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Sparse Fine-Tuning of Transformers for Generative Tasks ICCV 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence NAACL 2025
EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025
A4A: Adapter for Adapter Transfer via All-for-All Mapping for Cross-Architecture Models CVPR 2025
HFD-Teacher: High-Frequency Depth Distillation from Depth Foundation Models for Enhanced Depth Completion ICCV 2025
RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion ICCV 2025
Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance AAAI 2025
Can We Achieve Efficient Diffusion Without Self-Attention? Distilling Self-Attention into Convolutions ICCV 2025
SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection AAAI 2025
FVGen: Accelerating Novel-View Synthesis with Adversarial Video Diffusion Distillation ICCV 2025
Structure Balance and Gradient Matching-Based Signed Graph Condensation AAAI 2025
Who Taught You That? Tracing Teachers in Model Distillation ACL 2025
EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025
Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025
See Further When Clear: Curriculum Consistency Model CVPR 2025