← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA ACL 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
Three Pillars Improving Vision Foundation Model Distillation for Lidar CVPR 2024
IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation CVPR 2024
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation CVPR 2024
Small Scale Data-Free Knowledge Distillation CVPR 2024
To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024
LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024
Knowledge Distillation from Monolingual to Multilingual Models for Intelligent and Interpretable Multilingual Emotion Detection ACL 2024
Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract) AAAI 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024
Token-wise Influential Training Data Retrieval for Large Language Models ACL 2024
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024
Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024
Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification INTERSPEECH 2024
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning ACL 2024
Complementary Knowledge Distillation for Robust and Privacy-Preserving Model Serving in Vertical Federated Learning AAAI 2024
Bi-ViT: Pushing the Limit of Vision Transformer Quantization AAAI 2024
UDON: Universal Dynamic Online distillatioN for generic image representations NIPS 2024
Privileged Prior Information Distillation for Image Matting AAAI 2024
Cross-modal Representation Flattening for Multi-modal Domain Generalization NIPS 2024
Self-Distilled Depth Refinement with Noisy Poisson Fusion NIPS 2024
Label Attentive Distillation for GNN-Based Graph Classification AAAI 2024
EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NIPS 2024