← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Small Scale Data-Free Knowledge Distillation CVPR 2024
DI-V2X: Learning Domain-Invariant Representation for Vehicle-Infrastructure Collaborative 3D Object Detection AAAI 2024
Progressively Knowledge Distillation via Re-parameterizing Diffusion Reverse Process AAAI 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion NIPS 2024
A Kernel Perspective on Distillation-based Collaborative Learning NIPS 2024
Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024
Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging NIPS 2024
LSTKC: Long Short-Term Knowledge Consolidation for Lifelong Person Re-identification AAAI 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024
Improved Distribution Matching Distillation for Fast Image Synthesis NIPS 2024
Simple and Fast Distillation of Diffusion Models NIPS 2024
Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024
Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness NIPS 2024
Image Understanding Makes for A Good Tokenizer for Image Generation NIPS 2024
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression AAAI 2024
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher NIPS 2024
Label Attentive Distillation for GNN-Based Graph Classification AAAI 2024
FREE: Faster and Better Data-Free Meta-Learning CVPR 2024
Rethinking Reverse Distillation for Multi-Modal Anomaly Detection AAAI 2024
D3T: Distinctive Dual-Domain Teacher Zigzagging Across RGB-Thermal Gap for Domain-Adaptive Object Detection CVPR 2024
All but One: Surgical Concept Erasing with Model Preservation in Text-to-Image Diffusion Models AAAI 2024
Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024
Wired Perspectives: Multi-View Wire Art Embraces Generative AI CVPR 2024