← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Efficient Dataset Distillation via Minimax Diffusion CVPR 2024
Progressively Knowledge Distillation via Re-parameterizing Diffusion Reverse Process AAAI 2024
Omnipotent Distillation with LLMs for Weakly-Supervised Natural Language Video Localization: When Divergence Meets Consistency AAAI 2024
CrossKD: Cross-Head Knowledge Distillation for Object Detection CVPR 2024
Implanting LLM’s Knowledge via Reading Comprehension Tree for Toxicity Detection ACL 2024
Data-Free Quantization via Pseudo-label Filtering CVPR 2024
A Kernel Perspective on Distillation-based Collaborative Learning NIPS 2024
Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging NIPS 2024
Coconut: Contextualized Commonsense Unified Transformers for Graph-Based Commonsense Augmentation of Language Models ACL 2024
LSTKC: Long Short-Term Knowledge Consolidation for Lifelong Person Re-identification AAAI 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024
GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
Simple and Fast Distillation of Diffusion Models NIPS 2024
Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024
Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024
Class Incremental Learning with Multi-Teacher Distillation CVPR 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
CLIP-KD: An Empirical Study of CLIP Model Distillation CVPR 2024
Image Understanding Makes for A Good Tokenizer for Image Generation NIPS 2024
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression AAAI 2024
Video Event Extraction with Multi-View Interaction Knowledge Distillation AAAI 2024
FREE: Faster and Better Data-Free Meta-Learning CVPR 2024