← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

From SAM to DINOv2: Towards Distilling Foundation Models to Lightweight Baselines for Generalized Polyp Segmentation WACV 2026
Teach Small Models to Reason by Curriculum Distillation EMNLP 2025
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025
Empowering Persuasion Detection in Slavic Texts through Two-Stage Generative Reasoning ACL 2025
Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence ACL 2025
Recall with Reasoning: Chain-of-Thought Distillation for Mamba’s Long-Context Memory and Extrapolation EMNLP 2025
On Synthesizing Data for Context Attribution in Question Answering ACL 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Agentic-R1: Distilled Dual-Strategy Reasoning EMNLP 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning ACL 2025
Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models ACL 2025
Dianchi at SemEval-2025 Task 11: Multilabel Emotion Recognition via Orthogonal Knowledge Distillation ACL 2025
Emergent Wisdom at BEA 2025 Shared Task: From Lexical Understanding to Reflective Reasoning for Pedagogical Ability Assessment ACL 2025
Resource-Efficient Anonymization of Textual Data via Knowledge Distillation from Large Language Models COLING 2025
Safety Alignment via Constrained Knowledge Unlearning ACL 2025
Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025
Causal Inference with Large Language Model: A Survey NAACL 2025
Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy IJCAI 2025
VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025
Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning ICCV 2025
In-context Learning Demonstration Generation with Text Distillation IJCAI 2025
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025
HENT-SRT: Hierarchical Efficient Neural Transducer with Self-Distillation for Joint Speech Recognition and Translation ACL 2025