← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence NAACL 2025
Global-Semantic Alignment Distillation for Partial Multi-view Classification AAAI 2025
Hybrid Data-Free Knowledge Distillation AAAI 2025
A General Knowledge Injection Framework for ICD Coding ACL 2025
Multi-label Self Knowledge Distillation AAAI 2025
ScaleOT: Privacy-utility-scalable Offsite-tuning with Dynamic LayerReplace and Selective Rank Compression AAAI 2025
Fed-DFA: Federated Distillation for Heterogeneous Model Fusion Through the Adversarial Lens AAAI 2025
Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
A4A: Adapter for Adapter Transfer via All-for-All Mapping for Cross-Architecture Models CVPR 2025
Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025
Efficient Traffic Prediction Through Spatio-Temporal Distillation AAAI 2025
Incremental pre-training from smaller language models ACL 2024
SinSR: Diffusion-Based Image Super-Resolution in a Single Step CVPR 2024
A Privacy-preserving Approach to Ingest Knowledge from Proprietary Web-based to Locally Run Models for Medical Progress Note Generation ACL 2024
Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study NIPS 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering ACL 2024
Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs ACL 2024
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024
Efficient Dataset Distillation via Minimax Diffusion CVPR 2024
Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation ACL 2024
DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024
AS-ES Learning: Towards efficient CoT learning in small models ACL 2024
ELAD: Explanation-Guided Large Language Models Active Distillation ACL 2024
Expanding Expressiveness of Diffusion Models With Limited Data via Self-Distillation Based Fine-Tuning WACV 2024
Coconut: Contextualized Commonsense Unified Transformers for Graph-Based Commonsense Augmentation of Language Models ACL 2024