← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025
Soft Separation and Distillation: Toward Global Uniformity in Federated Unsupervised Learning ICCV 2025
Inference-Time Diffusion Model Distillation ICCV 2025
In-context Learning Demonstration Generation with Text Distillation IJCAI 2025
Recall with Reasoning: Chain-of-Thought Distillation for Mamba’s Long-Context Memory and Extrapolation EMNLP 2025
Just KIDDIN’ : Knowledge Infusion and Distillation for Detection of INdecent Memes ACL 2025
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025
Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy IJCAI 2025
A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality EMNLP 2025
TeEFusion: Blending Text Embeddings to Distill Classifier-Free Guidance ICCV 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
A Self-Distillation Recipe for Neural Machine Translation ACL 2025
Who Taught You That? Tracing Teachers in Model Distillation ACL 2025
Latte: Transfering LLMs' Latent-level Knowledge for Few-shot Tabular Learning IJCAI 2025
Towards the Law of Capacity Gap in Distilling Language Models ACL 2025
CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generation ACL 2025
In-Context Meta LoRA Generation IJCAI 2025
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025
AGRec: Adapting Autoregressive Decoders with Graph Reasoning for LLM-based Sequential Recommendation ACL 2025
Expanding the Category of Classifiers with LLM Supervision IJCAI 2025
Run LoRA Run: Faster and Lighter LoRA Implementations ACL 2025
Extended Abstract: Probing-Guided Parameter-Efficient Fine-Tuning for Balancing Linguistic Adaptation and Safety in LLM-based Social Influence Systems ACL 2025
FedCPD:Personalized Federated Learning with Prototype-Enhanced Representation and Memory Distillation IJCAI 2025
NAAM: Node-Aware Attention Mechanism for Distilling GNNs-to-MLP (Student Abstract) AAAI 2025