← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Depth Any Event Stream: Enhancing Event-based Monocular Depth Estimation via Dense-to-Sparse Distillation ICCV 2025
ATAS: Any-to-Any Self-Distillation for Enhanced Open-Vocabulary Dense Prediction ICCV 2025
Logic Distillation: Learning from Code Function by Function for Decision-making Tasks IJCAI 2025
Federated Low-Rank Adaptation for Foundation Models: A Survey IJCAI 2025
Who Taught You That? Tracing Teachers in Model Distillation ACL 2025
SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation ICCV 2025
Multilingual Continual Learning using Attention Distillation COLING 2025
LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks COLING 2025
Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems COLING 2025
Fraunhofer SIT at GenAI Detection Task 1: Adapter Fusion for AI-generated Text Detection COLING 2025
Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation COLING 2025
A Good Teacher Adapts Their Knowledge for Distillation ICCV 2025
What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025
From Holistic to Localized: Local Enhanced Adapters for Efficient Visual Instruction Fine-Tuning ICCV 2025
SALE-MLP: Structure Aware Latent Embeddings for GNN to Graph-free MLP Distillation IJCAI 2025
Lark: Low-Rank Updates After Knowledge Localization for Few-shot Class-Incremental Learning ICCV 2025
Balancing Forget Quality and Model Utility: A Reverse KL-Divergence Knowledge Distillation Approach for Better Unlearning in LLMs NAACL 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
Dynamic Feature Fusion for Sign Language Translation Using HyperNetworks NAACL 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
Machine Translation Metrics for Indigenous Languages Using Fine-tuned Semantic Embeddings NAACL 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025
Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025
Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025