← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Membership and Memorization in LLM Knowledge Distillation EMNLP 2025
A General Knowledge Injection Framework for ICD Coding ACL 2025
RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion ICCV 2025
Sparse Fine-Tuning of Transformers for Generative Tasks ICCV 2025
Moonshine: Distilling Game Content Generators into Steerable Generative Models AAAI 2025
Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025
ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025
Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025
Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding EMNLP 2025
On Collaborating Small and Large Models For Few-shot Intent Detection EMNLP 2025
Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025
Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025
Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025
DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation ACL 2025
Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation ACL 2025
One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit ACL 2025
Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering ACL 2025
CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images CVPR 2025
Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025
Spatial-Temporal Knowledge Distillation for Takeaway Recommendation AAAI 2025
LED-Merging: Mitigating Safety-Utility Conflicts in Model Merging with Location-Election-Disjoint ACL 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
Latent Diffusion-Enhanced Virtual Try-On via Optimized Pseudo-Label Generation AAAI 2025
Distilling Multi-modal Large Language Models for Autonomous Driving CVPR 2025
DPED: Multi-Layer Noise Distillation for Privacy-Preserving Text Embeddings EMNLP 2025