← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding ACL 2024
Implanting LLM’s Knowledge via Reading Comprehension Tree for Toxicity Detection ACL 2024
Optimizing Chinese Lexical Simplification Across Word Types: A Hybrid Approach EMNLP 2024
Improve Student’s Reasoning Generalizability through Cascading Decomposed CoTs Distillation EMNLP 2024
Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation ACL 2024
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024
DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language Models ACL 2024
AS-ES Learning: Towards efficient CoT learning in small models ACL 2024
RDRec: Rationale Distillation for LLM-based Recommendation ACL 2024
ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer ACL 2024
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition ACL 2024
Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation ACL 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic ACL 2024
D2LLM: Decomposed and Distilled Large Language Models for Semantic Search ACL 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios ACL 2024
Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models AAAI 2024
Progressive Distillation Based on Masked Generation Feature Method for Knowledge Graph Completion AAAI 2024
To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024
No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024
COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems AAAI 2024
Self-Distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach AAAI 2024
Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data AAAI 2024
FD3D: Exploiting Foreground Depth Map for Feature-Supervised Monocular 3D Object Detection AAAI 2024
Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024
Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition AAAI 2024