← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model EMNLP 2022
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning EMNLP 2022
Unifying the Convergences in Multilingual Neural Machine Translation EMNLP 2022
Bridging Fairness and Environmental Sustainability in Natural Language Processing EMNLP 2022
Distilled Dual-Encoder Model for Vision-Language Understanding EMNLP 2022
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation EMNLP 2022
Injecting Domain Knowledge in Language Models for Task-oriented Dialogue Systems EMNLP 2022
Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022
How Can a Teacher Make Learning From Sparse Data Softer? Application to Business Relation Extraction EMNLP 2022
Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models EMNLP 2022
The NiuTrans Machine Translation Systems for WMT22 EMNLP 2022
CrossQE: HW-TSC 2022 Submission for the Quality Estimation Shared Task EMNLP 2022
Edinburgh’s Submission to the WMT 2022 Efficiency Task EMNLP 2022
Language Adapters for Large-Scale MT: The GMU System for the WMT 2022 Large-Scale Machine Translation Evaluation for African Languages Shared Task EMNLP 2022
Samsung Research Philippines - Datasaur AI’s Submission for the WMT22 Large Scale Multilingual Translation Task EMNLP 2022
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NIPS 2022
Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation NIPS 2022
Symbolic Distillation for Learned TCP Congestion Control NIPS 2022
Hilbert Distillation for Cross-Dimensionality Networks NIPS 2022
BiT: Robustly Binarized Multi-distilled Transformer NIPS 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Fairness without Demographics through Knowledge Distillation NIPS 2022
Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks NIPS 2022
Let Images Give You More: Point Cloud Cross-Modal Training for Shape Analysis NIPS 2022
Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models NIPS 2022