← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

VL2Lite: Task-Specific Knowledge Distillation from Large Vision-Language Models to Lightweight Networks CVPR 2025
From Teacher to Student: Tracking Memorization Through Model Distillation ACL 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
Towards Universal Dataset Distillation via Task-Driven Diffusion CVPR 2025
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks CVPR 2025
Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025
Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025
Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025
Dianchi at SemEval-2025 Task 11: Multilabel Emotion Recognition via Orthogonal Knowledge Distillation ACL 2025
EdTec-ItemGen: Enhancing Retrieval-Augmented Item Generation Through Key Point Extraction ACL 2025
SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detection CVPR 2025
DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025
VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models CVPR 2025
CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation ICCV 2025
STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment ACL 2025
Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025
EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025
WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025
Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025
Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation ICCV 2025
ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models ICCV 2025
Agentic-R1: Distilled Dual-Strategy Reasoning EMNLP 2025
LaySummX at BioLaySumm: Retrieval-Augmented Fine-Tuning for Biomedical Lay Summarization Using Abstracts and Retrieved Full-Text Context ACL 2025
GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localization ICCV 2025