← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Teach Small Models to Reason by Curriculum Distillation EMNLP 2025
ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025
A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality EMNLP 2025
Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025
Logits-Based Finetuning EMNLP 2025
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation EMNLP 2025
Membership and Memorization in LLM Knowledge Distillation EMNLP 2025
Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation EMNLP 2025
Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs EMNLP 2025
StepER: Step-wise Knowledge Distillation for Enhancing Reasoning Ability in Multi-Step Retrieval-Augmented Language Models EMNLP 2025
Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework EMNLP 2025
EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models EMNLP 2025
L4: Mutual Learning Helps Lifelong Language Learning EMNLP 2025
Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding EMNLP 2025
Building Resource-Constrained Language Agents: A Korean Case Study on Chemical Toxicity Information EMNLP 2025
Learning Compatible Multi-Prize Subnetworks for Asymmetric Retrieval CVPR 2025
One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit ACL 2025
DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025
OPTICAL: Leveraging Optimal Transport for Contribution Allocation in Dataset Distillation CVPR 2025
Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectory CVPR 2025
Rationale-Guided Distillation for E-Commerce Relevance Classification: Bridging Large Language Models and Lightweight Cross-Encoders COLING 2025
Bridging the Gap: Efficient Cross-Lingual NER in Low-Resource Financial Domain COLING 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025
DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation CVPR 2025