← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025
Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models AAAI 2025
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training AAAI 2025
Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing AAAI 2025
Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks AAAI 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
Efficient Traffic Prediction Through Spatio-Temporal Distillation AAAI 2025
Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025
Mixture of Knowledge Minigraph Agents for Literature Review Generation AAAI 2025
Real-Time Neural Denoising with Render-Aware Knowledge Distillation AAAI 2025
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework NAACL 2025
Efficient Attention-Sharing Information Distillation Transformer for Lightweight Single Image Super-Resolution AAAI 2025
MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities AAAI 2025
Multi-turn Consistent Image Editing ICCV 2025
DCSF-KD: Dynamic Channel-wise Spatial Feature Knowledge Distillation for Object Detection AAAI 2025
DNB-AI-Project at SemEval-2025 Task 5: An LLM-Ensemble Approach for Automated Subject Indexing ACL 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025
LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025
QM-AI at SemEval-2025 Task 6: an Ensemble of BERT Models for Promise Identification in ESG Context ACL 2025
PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts AAAI 2025
Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025
KDAT: Inherent Adversarial Robustness via Knowledge Distillation with Adversarial Tuning for Object Detection Models AAAI 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025