← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025
Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models ACL 2025
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning ACL 2025
Efficient Diffusion as Low Light Enhancer CVPR 2025
Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework EMNLP 2025
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025
Empowering Persuasion Detection in Slavic Texts through Two-Stage Generative Reasoning ACL 2025
Emergent Wisdom at BEA 2025 Shared Task: From Lexical Understanding to Reflective Reasoning for Pedagogical Ability Assessment ACL 2025
Resource-Efficient Anonymization of Textual Data via Knowledge Distillation from Large Language Models COLING 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025
Causal Inference with Large Language Model: A Survey NAACL 2025
Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy IJCAI 2025
Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence ACL 2025
VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025
Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding EMNLP 2025
Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning ICCV 2025
DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025
In-context Learning Demonstration Generation with Text Distillation IJCAI 2025
On Synthesizing Data for Context Attribution in Question Answering ACL 2025
Safety Alignment via Constrained Knowledge Unlearning ACL 2025
OPTICAL: Leveraging Optimal Transport for Contribution Allocation in Dataset Distillation CVPR 2025