← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Unlocking the Potential of Reverse Distillation for Anomaly Detection AAAI 2025
Quantification of Large Language Model Distillation ACL 2025
CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation IJCNLP 2025
Dropout Connects Transformers and CNNs: Transfer General Knowledge for Knowledge Distillation WACV 2025
Learning Unified Distance Metric Across Diverse Data Distributions with Parameter-Efficient Transfer Learning WACV 2025
Cooperative Knowledge Distillation: A Learner Agnostic Approach AAAI 2024
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NIPS 2024
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis NIPS 2024
StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements EMNLP 2024
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning AAAI 2024
Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024
Knowledge-Enhanced Historical Document Segmentation and Recognition AAAI 2024
Tail-STEAK: Improve Friend Recommendation for Tail Users via Self-Training Enhanced Knowledge Distillation AAAI 2024
Decoupled Kullback-Leibler Divergence Loss NIPS 2024
Semi-Supervised Scene Change Detection by Distillation From Feature-Metric Alignment WACV 2024
Data Shunt: Collaboration of Small and Large Models for Lower Costs and Better Performance AAAI 2024
Distilling Reliable Knowledge for Instance-Dependent Partial Label Learning AAAI 2024
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning NIPS 2024
Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models NIPS 2024
Wakening Past Concepts Without Past Data: Class-Incremental Learning From Online Placebos WACV 2024
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation NIPS 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
Reinforced Cross-Domain Knowledge Distillation on Time Series Data NIPS 2024
From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024