← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024
Pauk at SemEval-2024 Task 4: A Neuro-Symbolic Method for Consistent Classification of Propaganda Techniques in Memes SEMEVAL 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models? EMNLP 2024
Text Simplification via Adaptive Teaching ACL 2024
Teaching Small Language Models Reasoning through Counterfactual Distillation EMNLP 2024
Advancing Large Language Model Attribution through Self-Improving EMNLP 2024
Dual Expert Distillation Network for Generalized Zero-Shot Learning IJCAI 2024
AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation EMNLP 2024
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation IJCAI 2024
Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study NIPS 2024
For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name Gender Prediction IJCAI 2024
Fine-Grained Distillation for Long Document Retrieval AAAI 2024
From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024
Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024
A Kernel Perspective on Distillation-based Collaborative Learning NIPS 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis NIPS 2024
Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NIPS 2024
Decoupled Kullback-Leibler Divergence Loss NIPS 2024
Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NIPS 2024
Self-Supervised Quantization-Aware Knowledge Distillation AISTATS 2024
Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure SEMEVAL 2024
Discrepancy and Uncertainty Aware Denoising Knowledge Distillation for Zero-Shot Cross-Lingual Named Entity Recognition AAAI 2024
Distilling Reliable Knowledge for Instance-Dependent Partial Label Learning AAAI 2024