Research Explorer
Papers
Conferences
Authors
Topics
Keywords
Trends
Achievements
Explore
← Learning Types
Deep Learning
›
Learning Types
›
Knowledge Distillation
790 directly classified papers
Papers per year
2014: 1
2016: 2
2017: 3
2018: 9
2019: 30
2020: 73
2021: 90
2022: 112
2023: 135
2024: 174
2025: 159
2026: 2
Papers
Adversarial Self-Supervised Data-Free Distillation for Text Classification
EMNLP 2020
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT
EMNLP 2020
TinyBERT: Distilling BERT for Natural Language Understanding
EMNLP 2020
WeChat Neural Machine Translation Systems for WMT20
EMNLP 2020
HW-TSC’s Participation in the WMT 2020 News Translation Shared Task
EMNLP 2020
Regularizing Class-Wise Predictions via Self-Knowledge Distillation
CVPR 2020
Explaining Knowledge Distillation by Quantifying the Knowledge
CVPR 2020
Spatio-Temporal Graph for Video Captioning With Knowledge Distillation
CVPR 2020
Inter-Region Affinity Distillation for Road Marking Segmentation
CVPR 2020
Creating Something From Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing
CVPR 2020
GAN Compression: Efficient Architectures for Interactive Conditional GANs
CVPR 2020
Maintaining Discrimination and Fairness in Class Incremental Learning
CVPR 2020
Search to Distill: Pearls Are Everywhere but Not the Eyes
CVPR 2020
Few Shot Network Compression via Cross Distillation
AAAI 2020
Class-incremental Learning via Deep Model Consolidation
WACV 2020
TKD: Temporal Knowledge Distillation for Active Perception
WACV 2020
Improving Autoregressive NMT with Non-Autoregressive Model
ACL 2020
End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020
ACL 2020
D3D: Distilled 3D Networks for Video Action Recognition
WACV 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
ACL 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer
CVPR 2020
The Knowledge Within: Methods for Data-Free Model Compression
CVPR 2020
Online Knowledge Distillation via Collaborative Learning
CVPR 2020
Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN
CVPR 2020
XtremeDistil: Multi-stage Distillation for Massive Multilingual Models
ACL 2020
<
1
…
27
28
29
…
32
>