← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Heuristic-free Knowledge Distillation for Streaming ASR via Multi-modal Training AAAI 2025
Howard University-AI4PC at SemEval-2025 Task 4: Unlearning Sensitive Content From Large Language Models Using Finetuning and Distillation for Selective Knowledge Removal ACL 2025
Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025
Toward Efficient Data-Free Unlearning AAAI 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
DataHacks at PerAnsSumm 2025: LoRA-Driven Prompt Engineering for Perspective Aware Span Identification and Summarization NAACL 2025
Fed-DFA: Federated Distillation for Heterogeneous Model Fusion Through the Adversarial Lens AAAI 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025
AcT2I: Evaluating and Improving Action Depiction in Text-to-Image Models EMNLP 2025
Cluster Based Heterogeneous Federated Foundation Model Adaptation and Fine-Tuning AAAI 2025
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework NAACL 2025
From Crafting Text to Crafting Thought: Grounding Intelligent Writing Support to Writing Center Pedagogy NAACL 2025
Efficient Traffic Prediction Through Spatio-Temporal Distillation AAAI 2025
Global-Semantic Alignment Distillation for Partial Multi-view Classification AAAI 2025
NAAM: Node-Aware Attention Mechanism for Distilling GNNs-to-MLP (Student Abstract) AAAI 2025
Soft Separation and Distillation: Toward Global Uniformity in Federated Unsupervised Learning ICCV 2025
Knowledge Distillation with Refined Logits ICCV 2025
KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder WACV 2025
Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025
DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025
Mixture of Knowledge Minigraph Agents for Literature Review Generation AAAI 2025
Controlling Equational Reasoning in Large Language Models with Prompt Interventions AAAI 2025
Prototypical Replay with Old-class Focusing Knowledge Distillation for Incremental Named Entity Recognition AAAI 2025
A Compact Model for Mathematics Problem Representations Distilled from BERT AAAI 2025